菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-01-08
📄 Abstract - Aligning Text, Code, and Vision: A Multi-Objective Reinforcement Learning Framework for Text-to-Visualization

Text-to-Visualization (Text2Vis) systems translate natural language queries over tabular data into concise answers and executable visualizations. While closed-source LLMs generate functional code, the resulting charts often lack semantic alignment and clarity, qualities that can only be assessed post-execution. Open-source models struggle even more, frequently producing non-executable or visually poor outputs. Although supervised fine-tuning can improve code executability, it fails to enhance overall visualization quality, as traditional SFT loss cannot capture post-execution feedback. To address this gap, we propose RL-Text2Vis, the first reinforcement learning framework for Text2Vis generation. Built on Group Relative Policy Optimization (GRPO), our method uses a novel multi-objective reward that jointly optimizes textual accuracy, code validity, and visualization quality using post-execution feedback. By training Qwen2.5 models (7B and 14B), RL-Text2Vis achieves a 22% relative improvement in chart quality over GPT-4o on the Text2Vis benchmark and boosts code execution success from 78% to 97% relative to its zero-shot baseline. Our models significantly outperform strong zero-shot and supervised baselines and also demonstrate robust generalization to out-of-domain datasets like VIS-Eval and NVBench. These results establish GRPO as an effective strategy for structured, multimodal reasoning in visualization generation. We release our code at this https URL.

顶级标签: llm natural language processing multi-modal
详细标签: text-to-visualization reinforcement learning multi-objective reward code generation visualization quality 或 搜索:

对齐文本、代码与视觉:一种用于文本到可视化的多目标强化学习框架 / Aligning Text, Code, and Vision: A Multi-Objective Reinforcement Learning Framework for Text-to-Visualization


1️⃣ 一句话总结

这篇论文提出了一个名为RL-Text2Vis的强化学习框架,它通过一个多目标奖励机制,在生成数据可视化图表时,能同时优化文本描述的准确性、生成代码的可执行性以及最终图表的视觉质量,从而显著提升了开源模型在文本到可视化任务上的表现。

源自 arXiv: 2601.04582