📄 论文总结
机器人挑战：大规模实机评估具身策略 / RoboChallenge: Large-scale Real-robot Evaluation of Embodied Policies
1️⃣ 一句话总结
这篇论文介绍了一个名为RoboChallenge的在线系统，旨在通过大规模、可重复的实机测试来高效评估机器人控制算法，并利用其初始基准Table30对当前先进的视觉语言动作模型进行了性能调查。
🤖 系统
Abstract - RoboChallenge: Large-scale Real-robot Evaluation of Embodied Policies
Testing on real machines is indispensable for robotic control algorithms. In the context of learning-based algorithms, especially VLA models, demand for large-scale evaluation, i.e. testing a large number of models on a large number of tasks, is becoming increasingly urgent. However, doing this right is highly non-trivial, especially when scalability and reproducibility is taken into account. In this report, we describe our methodology for constructing RoboChallenge, an online evaluation system to test robotic control algorithms, and our survey of recent state-of-the-art VLA models using our initial benchmark Table30.