菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-04-22
📄 Abstract - WebGen-R1: Incentivizing Large Language Models to Generate Functional and Aesthetic Websites with Reinforcement Learning

While Large Language Models (LLMs) excel at function-level code generation, project-level tasks such as generating functional and visually aesthetic multi-page websites remain highly challenging. Existing works are often limited to single-page static websites, while agentic frameworks typically rely on multi-turn execution with proprietary models, leading to substantial token costs, high latency, and brittle integration. Training a small LLM end-to-end with reinforcement learning (RL) is a promising alternative, yet it faces a critical bottleneck in designing reliable and computationally feasible rewards for website generation. Unlike single-file coding tasks that can be verified by unit tests, website generation requires evaluating inherently subjective aesthetics, cross-page interactions, and functional correctness. To this end, we propose WebGen-R1, an end-to-end RL framework tailored for project-level website generation. We first introduce a scaffold-driven structured generation paradigm that constrains the large open-ended action space and preserves architectural integrity. We then design a novel cascaded multimodal reward that seamlessly couples structural guarantees with execution-grounded functional feedback and vision-based aesthetic supervision. Extensive experiments demonstrate that our WebGen-R1 substantially transforms a 7B base model from generating nearly nonfunctional websites into producing deployable, aesthetically aligned multi-page websites. Remarkably, our WebGen-R1 not only consistently outperforms heavily scaled open-source models (up to 72B), but also rivals the state-of-the-art DeepSeek-R1 (671B) in functional success, while substantially exceeding it in valid rendering and aesthetic alignment. These results position WebGen-R1 as a viable path for scaling small open models from function-level code generation to project-level web application generation.

顶级标签: llm reinforcement learning aigc
详细标签: website generation multimodal reward aesthetic evaluation code generation reinforcement learning 或 搜索:

WebGen-R1:利用强化学习激励大语言模型生成功能完善且美观的网站 / WebGen-R1: Incentivizing Large Language Models to Generate Functional and Aesthetic Websites with Reinforcement Learning


1️⃣ 一句话总结

本文提出一种名为WebGen-R1的端到端强化学习框架,通过创新的结构化生成方法和多模态奖励机制,成功将仅有7B参数的小型语言模型从几乎无法生成有效网页训练成能产出功能完整、视觉美观的多页网站,性能超越了高达72B的开源模型,并在功能正确性与美观度上媲美671B的顶尖模型。

源自 arXiv: 2604.20398