MetaPoint:解锁智能体视觉生成中的精确空间控制 / MetaPoint: Unlocking Precise Spatial Control in Agentic Visual Generation
1️⃣ 一句话总结
本文提出MetaPoint方法,通过将连续二维坐标表示为一个特殊标记,在不改变模型架构的前提下,实现了对图像中物体位置和边框的像素级精确控制,从而为智能体视觉生成和交互式编辑提供了简单、可扩展的空间控制基础。
Generative visual models fundamentally struggle with precise spatial control. This arises from a core disconnect: models can process textual descriptions of space but cannot directly map numerical coordinates onto the 2D image canvas. We introduce MetaPoint, a method that bridges this gap by representing a continuous 2D coordinate as a single, special token. Crucially, MetaPoint requires no new architectural components; it directly leverages the model's inherent positional encoding schemes to interpret these coordinates, treating our token as a virtual point on the canvas. This lightweight approach enables pixel-level control of an object's position with one token or its bounding box with two, all without requiring architectural changes or bespoke attention masking. The MetaPoint tokens are designed to be compositional, serving as spatial primitives. This allows a planner agent to decompose a high-level user request into a structured sequence of primitives for the generator. By providing a simple, precise, and scalable building block for spatial control, MetaPoint unlocks more powerful compositional generative agents and enables intuitive, interactive editing systems.
MetaPoint:解锁智能体视觉生成中的精确空间控制 / MetaPoint: Unlocking Precise Spatial Control in Agentic Visual Generation
本文提出MetaPoint方法,通过将连续二维坐标表示为一个特殊标记,在不改变模型架构的前提下,实现了对图像中物体位置和边框的像素级精确控制,从而为智能体视觉生成和交互式编辑提供了简单、可扩展的空间控制基础。
源自 arXiv: 2606.05031