菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-04-30
📄 Abstract - Revealing the Impact of Visual Text Style on Attribute-based Descriptions Produced by Large Visual Language Models

When the visual style of text is considered, a wide variety can be observed in font, color, and size. However, when a word is read, its meaning is independent of the style in which it has been written or rendered. In this paper, we investigate whether, and how, the style in which a word is visualized in an image impacts the description that a Large Visual Language Model (LVLM) provides for the concept to which that word refers. Specifically, we investigate how functional text styles (readability-oriented, e.g., black sans-serif) versus decorative styles (display-oriented, e.g., colored cursive/script) affect LVLMs' descriptions of a concept in terms of the attributes of that concept. Our experiments study the situation in which the LVLM is able to correctly identify the concept referred to by a visual text, i.e., by a word or words rendered as an image, and in which the visual text style should not influence the attribute-based description that the LVLM produces. Our experimental results reveal that even when the concept is correctly identified, text style influences the model's attribute-based descriptions of the concept. Our findings demonstrate non-trivial style leakage from text style into semantic inference and motivate style-aware evaluation and mitigation for LVLM-based multimedia systems.

顶级标签: multi-modal model evaluation
详细标签: large visual language model text style attribute description style leakage visual text 或 搜索:

揭示视觉文本样式对大型视觉语言模型生成属性描述的影响 / Revealing the Impact of Visual Text Style on Attribute-based Descriptions Produced by Large Visual Language Models


1️⃣ 一句话总结

本研究通过实验发现,即使大型视觉语言模型能正确识别图片中的文字内容,文字的视觉样式(如字体、颜色、大小)仍会显著影响模型对该文字所指概念生成的属性描述,表明模型存在“样式泄漏”问题,亟需引入样式感知的评估与缓解策略。

源自 arXiv: 2604.27553