菜单

🤖 系统
📄 Abstract - VLASH: Real-Time VLAs via Future-State-Aware Asynchronous Inference

Vision-Language-Action models (VLAs) are becoming increasingly capable across diverse robotic tasks. However, their real-world deployment remains slow and inefficient: demonstration videos are often sped up by 5-10x to appear smooth, with noticeable action stalls and delayed reactions to environmental changes. Asynchronous inference offers a promising solution to achieve continuous and low-latency control by enabling robots to execute actions and perform inference simultaneously. However, because the robot and environment continue to evolve during inference, a temporal misalignment arises between the prediction and execution intervals. This leads to significant action instability, while existing methods either degrade accuracy or introduce runtime overhead to mitigate it. We propose VLASH, a general asynchronous inference framework for VLAs that delivers smooth, accurate, and fast reaction control without additional overhead or architectural changes. VLASH estimates the future execution-time state by rolling the robot state forward with the previously generated action chunk, thereby bridging the gap between prediction and execution. Experiments show that VLASH achieves up to 2.03x speedup and reduces reaction latency by up to 17.4x compared to synchronous inference while fully preserving the original accuracy. Moreover, it empowers VLAs to handle fast-reaction, high-precision tasks such as playing ping-pong and playing whack-a-mole, where traditional synchronous inference fails. Code is available at this https URL

顶级标签: robotics agents model evaluation
详细标签: asynchronous inference vision-language-action real-time control temporal alignment robot state prediction 或 搜索:

VLASH:通过未来状态感知的异步推理实现实时视觉-语言-动作模型 / VLASH: Real-Time VLAs via Future-State-Aware Asynchronous Inference


1️⃣ 一句话总结

这篇论文提出了一个名为VLASH的通用异步推理框架,它通过预测机器人执行动作时的未来状态,解决了现有视觉-语言-动作模型在实时控制中反应慢、动作卡顿的问题,从而在不增加额外开销或改变模型结构的情况下,实现了流畅、准确且低延迟的机器人控制,甚至能完成打乒乓球等快速反应任务。


📄 打开原文 PDF