RoboPocket:用你的手机即时改进机器人策略 / RoboPocket: Improve Robot Policies Instantly with Your Phone
1️⃣ 一句话总结
这篇论文提出了一个名为RoboPocket的创新系统,它利用普通智能手机和增强现实技术,让操作员无需物理机器人就能直观地看到机器人策略的预测轨迹,从而能高效地针对策略弱点收集数据并进行即时在线微调,将数据收集效率提升了一倍。
Scaling imitation learning is fundamentally constrained by the efficiency of data collection. While handheld interfaces have emerged as a scalable solution for in-the-wild data acquisition, they predominantly operate in an open-loop manner: operators blindly collect demonstrations without knowing the underlying policy's weaknesses, leading to inefficient coverage of critical state distributions. Conversely, interactive methods like DAgger effectively address covariate shift but rely on physical robot execution, which is costly and difficult to scale. To reconcile this trade-off, we introduce RoboPocket, a portable system that enables Robot-Free Instant Policy Iteration using single consumer smartphones. Its core innovation is a Remote Inference framework that visualizes the policy's predicted trajectory via Augmented Reality (AR) Visual Foresight. This immersive feedback allows collectors to proactively identify potential failures and focus data collection on the policy's weak regions without requiring a physical robot. Furthermore, we implement an asynchronous Online Finetuning pipeline that continuously updates the policy with incoming data, effectively closing the learning loop in minutes. Extensive experiments demonstrate that RoboPocket adheres to data scaling laws and doubles the data efficiency compared to offline scaling strategies, overcoming their long-standing efficiency bottleneck. Moreover, our instant iteration loop also boosts sample efficiency by up to 2$\times$ in distributed environments a small number of interactive corrections per person. Project page and videos: this https URL.
RoboPocket:用你的手机即时改进机器人策略 / RoboPocket: Improve Robot Policies Instantly with Your Phone
这篇论文提出了一个名为RoboPocket的创新系统,它利用普通智能手机和增强现实技术,让操作员无需物理机器人就能直观地看到机器人策略的预测轨迹,从而能高效地针对策略弱点收集数据并进行即时在线微调,将数据收集效率提升了一倍。
源自 arXiv: 2603.05504