菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-05-14
📄 Abstract - ATLAS: Agentic or Latent Visual Reasoning? One Word is Enough for Both

Visual reasoning, often interleaved with intermediate visual states, has emerged as a promising direction in the field. A straightforward approach is to directly generate images via unified models during reasoning, but this is computationally expensive and architecturally non-trivial. Recent alternatives include agentic reasoning through code or tool calls, and latent reasoning with learnable hidden embeddings. However, agentic methods incur context-switching latency from external execution, while latent methods lack task generalization and are difficult to train with autoregressive parallelization. To combine their strengths while mitigating their limitations, we propose ATLAS, a framework in which a single discrete 'word', termed as a functional token, serves both as an agentic operation and a latent visual reasoning unit. Each functional token is associated with an internalized visual operation, yet requires no visual supervision and remains a standard token in the tokenizer vocabulary, which can be generated via next-token prediction. This design avoids verbose intermediate visual content generation, while preserving compatibility with the vanilla scalable SFT and RL training, without architectural or methodological modifications. To further address the sparsity of functional tokens during RL, we introduce Latent-Anchored GRPO (LA-GRPO), which stabilizes the training by anchoring functional tokens with a statically weighted auxiliary objective, providing stronger gradient updates. Extensive experiments and analyses demonstrate that ATLAS achieves superior performance on challenging benchmarks while maintaining clear interpretability. We hope ATLAS offers a new paradigm inspiring future visual reasoning research.

顶级标签: multi-modal visual reasoning model training
详细标签: functional token latent reasoning agentic reasoning reinforcement learning visual reasoning benchmark 或 搜索:

ATLAS:代理型还是潜在视觉推理?一个词足矣 / ATLAS: Agentic or Latent Visual Reasoning? One Word is Enough for Both


1️⃣ 一句话总结

本文提出ATLAS框架,通过引入一种称为“功能词”的特殊离散词元,将代理型推理(通过代码或工具调用)与潜在推理(通过隐式嵌入)的优势结合,无需生成中间图像或修改模型结构,从而高效、可解释地完成复杂视觉推理任务,并配合一种稳定强化学习训练的新方法LA-GRPO,在多个基准测试中取得了领先性能。

源自 arXiv: 2605.15198