菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-06-23
📄 Abstract - IV-CoT: Implicit Visual Chain-of-Thought for Structure-Aware Text-to-Image Generation

Unified multi-modal large language models (MLLMs) have achieved strong text-to-image generation quality, but still struggle with structure-aware prompt following, where object counts, spatial relations, attribute bindings, and coarse layouts must be preserved. We attribute this limitation in part to the entanglement of structural planning and appearance rendering within a single conditioning stream. To address this issue, we propose Implicit Visual Chain-of-Thought (IV-CoT), a latent visual reasoning framework for query-conditioned image generation. IV-CoT decomposes the visual conditioning queries into a structural-to-semantic cascade, where structural queries first form a latent visual plan and semantic queries then render appearance conditioned on this plan. To guide the structural queries, we introduce training-only sketch supervision, which encourages them to capture structure from sketches without requiring sketch extraction or intermediate decoding at inference time. IV-CoT performs implicit CoT reasoning in a single forward pass and achieves superior results on GenEval and T2I-CompBench. Visualizations and analyses demonstrate that the learned structural and semantic queries play complementary roles in structure-aware generation.

顶级标签: multi-modal aigc llm
详细标签: text-to-image generation chain-of-thought structure-aware latent reasoning sketch supervision 或 搜索:

隐式视觉思维链:面向结构感知文本到图像生成 / IV-CoT: Implicit Visual Chain-of-Thought for Structure-Aware Text-to-Image Generation


1️⃣ 一句话总结

本文提出了一种名为隐式视觉思维链(IV-CoT)的方法,通过将视觉生成过程分解为结构规划和外观渲染两个步骤,有效提升了文本到图像模型对物体数量、空间位置等复杂指令的遵循能力。

源自 arXiv: 2606.24849