SJD-PAC:通过主动草拟与自适应延续加速推测性雅可比解码 / SJD-PAC: Accelerating Speculative Jacobi Decoding via Proactive Drafting and Adaptive Continuation
1️⃣ 一句话总结
这篇论文提出了一种名为SJD-PAC的改进方法,通过主动预测高难度区域的图像内容并允许在首次预测失败后继续尝试而非完全重来,从而在不损失图像质量的前提下,将文本生成图像的推理速度提升了约3.8倍。
Speculative Jacobi Decoding (SJD) offers a draft-model-free approach to accelerate autoregressive text-to-image synthesis. However, the high-entropy nature of visual generation yields low draft-token acceptance rates in complex regions, creating a bottleneck that severely limits overall throughput. To overcome this, we introduce SJD-PAC, an enhanced SJD framework. First, SJD-PAC employs a proactive drafting strategy to improve local acceptance rates in these challenging high-entropy regions. Second, we introduce an adaptive continuation mechanism that sustains sequence validation after an initial rejection, bypassing the need for full resampling. Working in tandem, these optimizations significantly increase the average acceptance length per step, boosting inference speed while strictly preserving the target distribution. Experiments on standard text-to-image benchmarks demonstrate that SJD-PAC achieves a $3.8\times$ speedup with lossless image quality.
SJD-PAC:通过主动草拟与自适应延续加速推测性雅可比解码 / SJD-PAC: Accelerating Speculative Jacobi Decoding via Proactive Drafting and Adaptive Continuation
这篇论文提出了一种名为SJD-PAC的改进方法,通过主动预测高难度区域的图像内容并允许在首次预测失败后继续尝试而非完全重来,从而在不损失图像质量的前提下,将文本生成图像的推理速度提升了约3.8倍。
源自 arXiv: 2603.18599