菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-07-08
📄 Abstract - Guidance Breaks the Fitted Operator: A Terminal-Fitted Repair for Classifier-Free Guidance

Classifier-free guidance (CFG) is the standard way to strengthen class-conditioning in diffusion and flow-matching samplers, yet at large guidance it oversaturates and destabilizes, symptoms practitioners suppress with more steps or limited-interval schedules. We analyze CFG through an asymptotic-preserving, numerical-analysis lens. Building on a recent result that the deterministic DDIM step is the unique fitted operator for the unguided terminal layer, exact on the final small-sigma stretch of sampling, we show that guidance re-stiffens exactly the discriminative subspace to an anomalous exponent 1+w. DDIM is therefore no longer fitted there, and on coarse meshes its guided residual diverges as sigma_min goes to zero. We prove a guided clock barrier with three ordered step-size thresholds, and read one-step oversaturation as its endpoint: a solver artifact on the calibration model rather than the continuous guided law. The same analysis yields a one-coefficient, zero-extra-NFE repair: replace CFG's w(r-1) by r^(1+w)-r on the guidance direction. On the calibration model's discriminative crossover, this removes CFG's sigma_min-divergent blow-up and is first-order accurate against the exact guided flow as sigma_min goes to zero. On learned CIFAR-10 checkpoints, and as a cross-domain smoke test on Stable Diffusion 1.5 DDIM, it acts as a high-guidance stabilizer at no extra cost rather than a universal quality knob: it cuts residual amplification and saturation, gives 9/9 point-FID wins over CFG on the tested grid, and preserves classifier-proxy target accuracy in the hard-cell blocks. We report the limits alongside: it is not a universal image-quality win, and against a dense vanilla-CFG reference it is not a uniformly better integrator of that field.

顶级标签: machine learning theory
详细标签: classifier-free guidance diffusion models numerical analysis guidance stabilization fitted operator 或 搜索:

引导符打破拟合算子:针对无分类器引导的终端拟合修复 / Guidance Breaks the Fitted Operator: A Terminal-Fitted Repair for Classifier-Free Guidance


1️⃣ 一句话总结

本文通过数值分析发现,无分类器引导(CFG)在强大引导下会导致采样过程失稳和过饱和,其根源在于引导破坏了原本完美拟合的离散算子;作者提出了一种无需额外计算成本的简单修复方法,即调整引导方向的计算方式,有效消除了残差发散和过饱和问题,并在多个扩散模型上验证了其稳定效果。

源自 arXiv: 2607.07665