菜单

🤖 系统
📄 Abstract - Ariadne: A Controllable Framework for Probing and Extending VLM Reasoning Boundaries

While Vision-Language Models (VLMs) post-trained with Reinforcement Learning (RL) show impressive general reasoning, their evaluation is often confined to language-dominant tasks (e.g., math). This raises a critical question: can RL post-training truly extend the inherent capability boundary of a base VLM, particularly for visual-centric spatial tasks where it initially fails? To investigate this, we introduce Ariadne, a framework utilizing synthetic mazes for multi-step spatial reasoning where task difficulty (e.g., path length, turns) is precisely controlled. We leverage this controllable environment to train VLMs using Reinforcement Learning with Verified Rewards (RLVR) in a difficulty-aware curriculum. Surprisingly, post-RLVR training, the VLM achieves over 50% accuracy on a problem set where the base model scored 0%, demonstrating that our approach expands the model's initial capability boundary. To assess real-world viability, we evaluate out-of-distribution (OOD) generalization on practical benchmarks. Despite training only on synthetic maze samples, Ariadne achieves significant zero-shot improvements, averaging 16% on MapBench (e.g., museum navigation) and 24% on ReasonMap (subway transfer tasks). These results confirm that our method not only broadens the model's fundamental limits but also enhances its generalization to real-world spatial reasoning. We acknowledge our study is limited to the post-training phase, given the opaqueness of pre-training data, and hope our research motivates further work on specialized, capability-extending alignment.

顶级标签: multi-modal model training model evaluation
详细标签: vision-language models spatial reasoning reinforcement learning capability evaluation synthetic data 或 搜索:

📄 论文总结

阿里阿德涅:一个用于探索和扩展视觉语言模型推理边界的可控框架 / Ariadne: A Controllable Framework for Probing and Extending VLM Reasoning Boundaries


1️⃣ 一句话总结

这篇论文提出了一个名为Ariadne的可控框架,通过使用合成迷宫进行强化学习训练,成功扩展了视觉语言模型在视觉主导的空间推理任务上的能力边界,并显著提升了模型在真实世界导航任务中的零样本泛化性能。


📄 打开原文 PDF