超越平面贴片:通过视角一致的3D对抗物体探索视觉运动策略的脆弱性 / Beyond the Patch: Exploring Vulnerabilities of Visuomotor Policies via Viewpoint-Consistent 3D Adversarial Object
1️⃣ 一句话总结
这篇论文提出了一种为3D物体生成视角一致性对抗纹理的方法,能有效欺骗机器人视觉控制系统,使其在动态视角和真实环境中持续做出错误决策,揭示了现有机器人策略在三维感知上的安全漏洞。
Neural network-based visuomotor policies enable robots to perform manipulation tasks but remain susceptible to perceptual attacks. For example, conventional 2D adversarial patches are effective under fixed-camera setups, where appearance is relatively consistent; however, their efficacy often diminishes under dynamic viewpoints from moving cameras, such as wrist-mounted setups, due to perspective distortions. To proactively investigate potential vulnerabilities beyond 2D patches, this work proposes a viewpoint-consistent adversarial texture optimization method for 3D objects through differentiable rendering. As optimization strategies, we employ Expectation over Transformation (EOT) with a Coarse-to-Fine (C2F) curriculum, exploiting distance-dependent frequency characteristics to induce textures effective across varying camera-object distances. We further integrate saliency-guided perturbations to redirect policy attention and design a targeted loss that persistently drives robots toward adversarial objects. Our comprehensive experiments show that the proposed method is effective under various environmental conditions, while confirming its black-box transferability and real-world applicability.
超越平面贴片:通过视角一致的3D对抗物体探索视觉运动策略的脆弱性 / Beyond the Patch: Exploring Vulnerabilities of Visuomotor Policies via Viewpoint-Consistent 3D Adversarial Object
这篇论文提出了一种为3D物体生成视角一致性对抗纹理的方法,能有效欺骗机器人视觉控制系统,使其在动态视角和真实环境中持续做出错误决策,揭示了现有机器人策略在三维感知上的安全漏洞。
源自 arXiv: 2603.04913