HAVEN:面向UVM测试平台合成的混合自动验证引擎 / HAVEN: Hybrid Automated Verification ENgine for UVM Testbench Synthesis with LLMs
1️⃣ 一句话总结
为解决大语言模型在芯片验证中生成硬件描述代码困难的问题,本文提出HAVEN系统,它通过结构化模板和专用领域语言替代直接编写代码,在多个接口协议上实现了接近90%的测试覆盖率,大幅提升了自动化验证的可靠性。
Integrated Circuit (IC) verification consumes nearly 70% of the IC development cycle, and recent research leverages Large Language Models (LLMs) to automatically generate testbenches and reduce verification overhead. However, LLMs have difficulty generating testbenches correctly. Unlike high-level programming languages, Hardware Description Languages (HDLs) are extremely rare in LLMs training data, leading LLMs to produce incorrect code. To overcome challenges when using LLMs to generate Universal Verification Methodology (UVM) testbenches and sequences, wepropose HAVEN (Hybrid Automated Verification ENgine) to prevent LLMs from writing HDL directly. For UVM testbench generation, HAVEN utilizes LLM agents to analyze design specifications to produce a structured architectural plan. The HAVEN Template Engine then combines with predefined and protocol-specific templates to generate all UVM components with correct bus-handshake timing. For UVM sequence generation, HAVEN introduces a Protocol-Aware Sequence Domain-Specific Language (DSL) that decomposes sequences into fine-grained step types. A set of predefined DSL patterns first establishes sequences that achieve a high coverage rate without LLM involvement. HAVEN continues to improve the coverage rate by iteratively leveraging LLM agents to analyze coverage gap reports and compose additional targeted DSL sequences. Unlike previous works, HAVEN is the first system that utilizes pre-defined, protocol-specific Jinja2 templates to generate all UVM components and UVM sequences using our proposed Protocol-Aware DSL and rule-based code generator. Our experimental results on 19 open-source IP designs spanning three interface protocols (Direct, Wishbone, AXI4-Lite) show that HAVEN achieves 100% compilation success, 90.6% code coverage, and 87.9% functional coverage on average, and is SOTA among LLM-assisted testbench generation systems.
HAVEN:面向UVM测试平台合成的混合自动验证引擎 / HAVEN: Hybrid Automated Verification ENgine for UVM Testbench Synthesis with LLMs
为解决大语言模型在芯片验证中生成硬件描述代码困难的问题,本文提出HAVEN系统,它通过结构化模板和专用领域语言替代直接编写代码,在多个接口协议上实现了接近90%的测试覆盖率,大幅提升了自动化验证的可靠性。
源自 arXiv: 2604.27643