用漫画思考:通过结构化视觉叙事增强多模态推理 / Thinking with Comics: Enhancing Multimodal Reasoning through Structured Visual Storytelling
1️⃣ 一句话总结
这篇论文提出了一种名为‘用漫画思考’的新方法,它利用漫画这种信息密度高、结构清晰的视觉媒介,在图片和视频之间找到了一个平衡点,从而更高效、更准确地进行多步骤的时间和因果推理任务。
Chain-of-Thought reasoning has driven large language models to extend from thinking with text to thinking with images and videos. However, different modalities still have clear limitations: static images struggle to represent temporal structure, while videos introduce substantial redundancy and computational cost. In this work, we propose Thinking with Comics, a visual reasoning paradigm that uses comics as a high information-density medium positioned between images and videos. Comics preserve temporal structure, embedded text, and narrative coherence while requiring significantly lower reasoning cost. We systematically study two reasoning paths based on comics and evaluate them on a range of reasoning tasks and long-context understanding tasks. Experimental results show that Thinking with Comics outperforms Thinking with Images on multi-step temporal and causal reasoning tasks, while remaining substantially more efficient than Thinking with Video. Further analysis indicates that different comic narrative structures and styles consistently affect performance across tasks, suggesting that comics serve as an effective intermediate visual representation for improving multimodal reasoning.
用漫画思考:通过结构化视觉叙事增强多模态推理 / Thinking with Comics: Enhancing Multimodal Reasoning through Structured Visual Storytelling
这篇论文提出了一种名为‘用漫画思考’的新方法,它利用漫画这种信息密度高、结构清晰的视觉媒介,在图片和视频之间找到了一个平衡点,从而更高效、更准确地进行多步骤的时间和因果推理任务。
源自 arXiv: 2602.02453