菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-04-14
📄 Abstract - Accelerating Speculative Decoding with Block Diffusion Draft Trees

Speculative decoding accelerates autoregressive language models by using a lightweight drafter to propose multiple future tokens, which the target model then verifies in parallel. DFlash shows that a block diffusion drafter can generate an entire draft block in a single forward pass and achieve state-of-the-art speculative decoding performance, outperforming strong autoregressive drafters such as EAGLE-3. Vanilla DFlash, however, still verifies only a single drafted trajectory per round, potentially limiting its acceptance length. We introduce DDTree (Diffusion Draft Tree), a method that constructs a draft tree directly from the per-position distributions of a block diffusion drafter. Under a fixed node budget, DDTree uses a simple best-first heap algorithm to select the continuations that are most likely to match the target model according to a surrogate defined by the draft model's output. The resulting tree is verified efficiently in a single target model forward pass using an ancestor-only attention mask. Because DDTree builds on DFlash, a leading draft model for speculative decoding, these gains place DDTree among the leading approaches to speculative decoding.

顶级标签: llm model training systems
详细标签: speculative decoding inference acceleration diffusion models autoregressive generation attention masking 或 搜索:

利用块扩散草稿树加速推测解码 / Accelerating Speculative Decoding with Block Diffusion Draft Trees


1️⃣ 一句话总结

这篇论文提出了一种名为DDTree的新方法,它通过改进现有的块扩散草稿模型,构建一个多分支的“草稿树”来预测更多可能的后续文本,从而让大型语言模型在生成文本时能一次性验证多个候选路径,显著提升了文本生成的速度和效率。

源自 arXiv: 2604.12989