基于语义感知空间加权的自创文生图生成方法 / Self-Creative Text-to-Object Generation using Semantic-Aware Spatial Weighting
1️⃣ 一句话总结
该论文提出了一种名为SCDiff的创新扩散模型,通过可学习的空间加权模块和视觉语义混合损失函数,在保持文本描述准确性的同时,引导模型生成具有视觉新颖性、意外感和艺术价值的图像,从而解决了现有文生图模型难以真正创造新意的难题。
Instilling creativity in text-to-image (T2I) generation presents a significant challenge, as it requires synthesized images to exhibit not only visual novelty and surprise, but also artistic value. Current T2I models, however, are largely optimized for literal text-image alignment with their data distribution, and their noise prediction networks constrain the generation to high-probability regions, consequently generating outputs that lack authentic creativity. To address this, we propose a Self-Creative Diffusion (SCDiff) model for meaningful T2I generations featuring two core modules: a learnable spatial weighting (LSW) module and a visual-semantic mixing loss (VSML). The LSW module designs a parametric Kaiser-Bessel window to reinforce central image features, fostering novel and surprising generation. The VSML module introduces a dual loss function: a similarity loss constrains that the new images align with its textual description, while a diversity loss maximizes its distinction from the original image, enhancing both semantic value and visual novelty. Extensive experiments demonstrate that our model substantially improves creativity, semantic alignment, and visual coherence, offering a simple yet powerful framework for generating creative objects.
基于语义感知空间加权的自创文生图生成方法 / Self-Creative Text-to-Object Generation using Semantic-Aware Spatial Weighting
该论文提出了一种名为SCDiff的创新扩散模型,通过可学习的空间加权模块和视觉语义混合损失函数,在保持文本描述准确性的同时,引导模型生成具有视觉新颖性、意外感和艺术价值的图像,从而解决了现有文生图模型难以真正创造新意的难题。
源自 arXiv: 2605.19554