面向多样采样的方差倾斜扩散模型 / Variance-Tilted Diffusion Models for Diverse Sampling
1️⃣ 一句话总结
本论文提出了一种改进的扩散模型采样方法,通过引入粒子间相互作用,使得生成的样本集合在特定特征上具有更大的方差,从而在保持质量的同时显著提升采样结果的多样性。
Diffusion models are typically sampled independently, even when the downstream objective is to obtain a diverse set of candidates. We introduce a variance-weighted batch distribution that favours collections of samples with large empirical spread after a prescribed linear feature map. The target is specified explicitly, and the sampler is derived as the corresponding Doob $h$-transform of independent diffusion dynamics. The resulting correction has a compact form: an interaction term that repels posterior denoised means, together with a curvature term that moves particles to the region of higher feature variance. This yields an interacting-particle sampler with a transparent probabilistic target rather than a heuristic repulsive drift.
面向多样采样的方差倾斜扩散模型 / Variance-Tilted Diffusion Models for Diverse Sampling
本论文提出了一种改进的扩散模型采样方法,通过引入粒子间相互作用,使得生成的样本集合在特定特征上具有更大的方差,从而在保持质量的同时显著提升采样结果的多样性。
源自 arXiv: 2606.22239