📄
Abstract - Dashboard2Code: Evaluating Multimodal Models on Reconstructing Interactive Dashboards
Automatic data visualization generation has advanced rapidly with multi-modal large language models, yet existing efforts largely focus on static charts and overlook the interactive dashboards commonly used for real-world data exploration. We introduce Dashboard2Code, a novel task that requires a model to proactively explore an interactive dashboard, acquire and integrate feedback from its own interactions (e.g., clicking and filtering), and generate code that reproduces the target dashboard. To support comprehensive evaluation, we present DashboardMimic, the first Plotly+Dash benchmark for Dashboard2Code, comprising 180 carefully designed and manually verified dashboard-code pairs spanning three difficulty levels and covering eight common real-world interaction patterns. We further propose an automated evaluation framework tailored to dashboards that combines code semantic analysis with dynamic interaction-based testing to assess visual and interaction consistency, showing strong agreement with human judgments. Experiments across a range of open- and closed-source multi-modal models reveal that even the strongest systems struggle on high-complexity dashboards and that a substantial performance gap remains between open-source and closed-source models on the Dashboard2Code task.
Dashboard2Code:评估多模态模型在交互式仪表盘重建上的表现 /
Dashboard2Code: Evaluating Multimodal Models on Reconstructing Interactive Dashboards
1️⃣ 一句话总结
本文提出了一项新任务Dashboard2Code,要求多模态大模型通过主动点击和筛选等交互来探索一个交互式仪表盘,并生成能复现该仪表盘的代码,同时构建了首个包含180个仪表盘-代码对的标准基准和自动评估框架,测试发现即使是目前最强的模型在处理复杂仪表盘时仍然存在困难,且开源模型与闭源模型之间差距显著。