Mana:灵巧操纵铰接工具 / Mana: Dexterous Manipulation of Articulated Tools
1️⃣ 一句话总结
本文提出了一个名为Mana的通用仿真到现实框架,通过将灵巧操作问题转化为动画生成问题,实现了对剪刀、钳子等各类铰接工具的零样本灵活抓取和操作。
Articulated tool manipulation remains a major challenge in dexterous robotics due to the need to coordinate internal degrees of freedom and contact-rich interactions. While prior work has largely focused on rigid objects, articulated tool use remains underexplored because of its physical complexity and the difficulty of learning functional grasping and manipulation policies. We present Mana (Manipulation Animator), a general sim-to-real framework that reinterprets dexterous manipulation as an animation problem. Inspired by computer animation, Mana employs a coarse-to-fine pipeline that transforms procedurally-generated grasp keyframes into manipulation trajectories through motion planning and reinforcement learning. The data generation process is largely automatic, requiring only a few mouse clicks to specify functional affordances (<1 minute per tool). Across four articulated tools spanning different scales and joint types, Mana achieves zero-shot sim-to-real transfer for both grasping and in-hand manipulation, demonstrating a scalable approach to dexterous articulated tool use.
Mana:灵巧操纵铰接工具 / Mana: Dexterous Manipulation of Articulated Tools
本文提出了一个名为Mana的通用仿真到现实框架,通过将灵巧操作问题转化为动画生成问题,实现了对剪刀、钳子等各类铰接工具的零样本灵活抓取和操作。
源自 arXiv: 2606.13677