📄
Abstract - Training-Free Acceleration for Vision-Language-Action Models with Action Caching and Refinement
Vision-Language-Action (VLA) models have emerged as a promising approach for generalizable robotic manipulations. In particular, flow matching-based VLA models have shown remarkable success due to their capability to generate precise and smooth action sequences and capture multimodal distributions. However, the iterative denoising process in the action head acts as a major computational bottleneck, posing a critical challenge for real-time deployment. To address this challenge, we propose ActionCache, a plug-and-play external cache that opportunistically reuses past intermediate actions to warm-start generations from the vicinity of target actions, thereby drastically reducing the inference latency. Specifically, ActionCache stores the intermediate actions with compact multimodal keys, which enables retrieval from similar past contexts across different episodes or even different tasks. Experimental results in simulation and real-world environments demonstrate that ActionCache maintains high task success rates in a low-latency regime, achieving inference acceleration of up to $11.75\times$ and $34.43\times$ for representative flow-based VLA models, $\pi_{0.5}$ and GR00T-N1.6, respectively.
无需额外训练的视觉-语言-动作模型加速:通过动作缓存与精炼实现 /
Training-Free Acceleration for Vision-Language-Action Models with Action Caching and Refinement
1️⃣ 一句话总结
本文提出了一种名为ActionCache的插件式缓存方法,通过复用过去相近情境中的中间动作来“热身”生成过程,大幅加快视觉-语言-动作机器人的推理速度,在不额外训练模型的情况下,实现了最高34倍的加速效果,同时保持高任务成功率。