菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-06-22
📄 Abstract - Semantic Browsing: Controllable Diversity for Image Generation

Modern text-to-image models excel in visual fidelity and prompt adherence. However, this strict adherence comes at the cost of diversity: generated samples tend to collapse into a single visual interpretation. Existing methods to improve diversity produce outputs driven by incidental variations rather than meaningful design choices. This motivates a new variant of the diversity task where structure is enforced on the generated samples. We introduce a method for controlled diversity that enables Semantic Browsing, where users can navigate structured image galleries and experience creative exploration through a systematic traversal of meaningful, interpretable axes of variation. Achieving this level of semantic control requires a deep understanding of the scene. We exploit the fact that recent text-to-image models are trained on elaborated captions, effectively decoupling semantic decision-making from pixel generation. This enables a paradigm shift: instead of relying on stochastic variation within the text-to-image model, we induce diversity directly at the text level. By leveraging rich textual representations, we allow a Vision Language Model (VLM) to operate on the full scene context. To overcome the generic outputs typical of standard VLMs, we employ an agentic workflow that explicitly enforces structured variation attuned to the original prompt. We demonstrate that our method produces diverse and navigable design spaces where every variation corresponds to a specific, user-understandable semantic decision.

顶级标签: multi-modal aigc agents
详细标签: text-to-image controllable diversity vision language model semantic browsing agentic workflow 或 搜索:

语义浏览:图像生成中的可控多样性 / Semantic Browsing: Controllable Diversity for Image Generation


1️⃣ 一句话总结

本文提出一种名为“语义浏览”的新方法,通过让视觉语言模型在文本层面主动调整描述文字,从而生成一系列在语义上有所不同、且每种变化都对应着用户可以理解的设计选择,解决了现有图像生成模型在提升多样性时缺乏可控性和可解读性的问题。

源自 arXiv: 2606.23679