菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-03-05
📄 Abstract - Beyond the Patch: Exploring Vulnerabilities of Visuomotor Policies via Viewpoint-Consistent 3D Adversarial Object

Neural network-based visuomotor policies enable robots to perform manipulation tasks but remain susceptible to perceptual attacks. For example, conventional 2D adversarial patches are effective under fixed-camera setups, where appearance is relatively consistent; however, their efficacy often diminishes under dynamic viewpoints from moving cameras, such as wrist-mounted setups, due to perspective distortions. To proactively investigate potential vulnerabilities beyond 2D patches, this work proposes a viewpoint-consistent adversarial texture optimization method for 3D objects through differentiable rendering. As optimization strategies, we employ Expectation over Transformation (EOT) with a Coarse-to-Fine (C2F) curriculum, exploiting distance-dependent frequency characteristics to induce textures effective across varying camera-object distances. We further integrate saliency-guided perturbations to redirect policy attention and design a targeted loss that persistently drives robots toward adversarial objects. Our comprehensive experiments show that the proposed method is effective under various environmental conditions, while confirming its black-box transferability and real-world applicability.

顶级标签: robotics computer vision model evaluation
详细标签: adversarial attack visuomotor policy 3d object differentiable rendering robotic manipulation 或 搜索:

超越平面贴片:通过视角一致的3D对抗物体探索视觉运动策略的脆弱性 / Beyond the Patch: Exploring Vulnerabilities of Visuomotor Policies via Viewpoint-Consistent 3D Adversarial Object


1️⃣ 一句话总结

这篇论文提出了一种为3D物体生成视角一致性对抗纹理的方法,能有效欺骗机器人视觉控制系统,使其在动态视角和真实环境中持续做出错误决策,揭示了现有机器人策略在三维感知上的安全漏洞。

源自 arXiv: 2603.04913