HTMLCure:将浏览器体验转化为交互式HTML的状态指导修复框架 / HTMLCure: Turning Browser Experience into State Guided Repair for Interactive HTML
1️⃣ 一句话总结
HTMLCure提出了一种通过让大语言模型生成的网页在真实浏览器中交互执行(如滚动、点击、拖拽),并利用执行过程中的状态信息指导自动修复缺陷的方法,从而大幅提升动态HTML页面的可用性,并显著增强模型在该任务上的表现。
LLMs can now produce full HTML pages, but many of those pages are only superficially correct: they render once, then fail under scroll, hover, click, resize, or gameplay. Evaluation from screenshots can miss these failures, and filtering discards many pages that are still repairable. We introduce HTMLCure, a browser experience framework that evaluates HTML after the system has interacted with it. The evaluator executes the page across viewports and interaction states, records deterministic browser evidence, and gives the VLM curated keyframes from the executed trajectory rather than isolated screenshots. The same state signal drives a closed loop repair engine: HTMLCure diagnoses the current page, chooses a state specific repair family, runs each candidate again, and exports quality cleared pages for SFT. On a 97K prompt corpus, this expands the directly usable seed into a candidate pool of 63703 quality cleared pages, from which we construct the final refined SFT set of 40K pages. Under the same backbone and training recipe, HTMLCure-27B-Refined reaches 50.6 on HTMLBench-400 with 45.2% deterministic test case pass, placing it in the same performance band as strong reference rows such as Kimi-K2.6 and GPT-5.4. On the released MiniAppBench validation split, it reaches 81.2 average, improving raw 27B SFT by 15.3 points and approaching the level of strong reference systems.
HTMLCure:将浏览器体验转化为交互式HTML的状态指导修复框架 / HTMLCure: Turning Browser Experience into State Guided Repair for Interactive HTML
HTMLCure提出了一种通过让大语言模型生成的网页在真实浏览器中交互执行(如滚动、点击、拖拽),并利用执行过程中的状态信息指导自动修复缺陷的方法,从而大幅提升动态HTML页面的可用性,并显著增强模型在该任务上的表现。
源自 arXiv: 2605.26807