菜单

🤖 系统
📄 Abstract - WebVIA: A Web-based Vision-Language Agentic Framework for Interactive and Verifiable UI-to-Code Generation

User interface (UI) development requires translating design mockups into functional code, a process that remains repetitive and labor-intensive. While recent Vision-Language Models (VLMs) automate UI-to-Code generation, they generate only static HTML/CSS/JavaScript layouts lacking interactivity. To address this, we propose WebVIA, the first agentic framework for interactive UI-to-Code generation and validation. The framework comprises three components: 1) an exploration agent to capture multi-state UI screenshots; 2) a UI2Code model that generates executable interactive code; 3) a validation module that verifies the interactivity. Experiments demonstrate that WebVIA-Agent achieves more stable and accurate UI exploration than general-purpose agents (e.g., Gemini-2.5-Pro). In addition, our fine-tuned WebVIA-UI2Code models exhibit substantial improvements in generating executable and interactive HTML/CSS/JavaScript code, outperforming their base counterparts across both interactive and static UI2Code benchmarks. Our code and models are available at \href{this https URL}{\texttt{this https URL}}.

顶级标签: agents computer vision multi-modal
详细标签: ui-to-code vision-language models interactive code generation agentic framework ui validation 或 搜索:

📄 论文总结

WebVIA:一种基于Web的视觉语言智能体框架,用于交互式且可验证的UI到代码生成 / WebVIA: A Web-based Vision-Language Agentic Framework for Interactive and Verifiable UI-to-Code Generation


1️⃣ 一句话总结

这篇论文提出了一个名为WebVIA的创新框架,它通过智能体协作自动将用户界面设计图转换为可交互的网页代码,并验证代码功能,显著提升了UI开发的自动化水平和准确性。


📄 打开原文 PDF