用于空间推理的几何约束智能体 / Geometrically-Constrained Agent for Spatial Reasoning
1️⃣ 一句话总结
这篇论文提出了一种名为GCA的新方法,通过将视觉语言模型的角色分解为‘语义分析’和‘任务求解’两个阶段,并引入形式化的几何约束来严格指导推理过程,从而有效解决了现有模型在空间推理中语义理解与几何精度不匹配的核心问题,无需额外训练即可在多个基准测试上显著超越现有方法。
Vision Language Models (VLMs) exhibit a fundamental semantic-to-geometric gap in spatial reasoning: they excel at qualitative semantic inference but their reasoning operates within a lossy semantic space, misaligned with high-fidelity geometry. Current paradigms fail to bridge this gap. Training-based methods suffer from an ``oracle paradox,'' learning flawed spatial logic from imperfect oracles. Tool-integrated methods constrain the final computation but critically leave the VLM's planning process unconstrained, resulting in geometrically flawed plans. In this work, we propose Geometrically-Constrained Agent (GCA), a training-free agentic paradigm that resolves this gap by introducing a formal task constraint. Specifically, we strategically decouples the VLM's role into two stages. First, acting as a semantic analyst, the VLM translates the user's ambiguous query into the formal, verifiable task constraint, which defines the reference frame and objective. Second, acting as a task solver, the VLM generates and executes tool calls strictly within the deterministic bounds defined by the constraint. This geometrically-constrained reasoning strategy successfully resolve the semantic-to-geometric gap, yielding a robust and verifiable reasoning pathway for spatial reasoning. Comprehensive experiments demonstrate that GCA achieves SOTA performance on multiple spatial reasoning benchmarks, surpassing existing training-based and tool-integrated methods by ~27%. Please see our homepage at this https URL.
用于空间推理的几何约束智能体 / Geometrically-Constrained Agent for Spatial Reasoning
这篇论文提出了一种名为GCA的新方法,通过将视觉语言模型的角色分解为‘语义分析’和‘任务求解’两个阶段,并引入形式化的几何约束来严格指导推理过程,从而有效解决了现有模型在空间推理中语义理解与几何精度不匹配的核心问题,无需额外训练即可在多个基准测试上显著超越现有方法。