菜单

关于 🐙 GitHub
arXiv 提交日期: 2025-12-20
📄 Abstract - Is There a Better Source Distribution than Gaussian? Exploring Source Distributions for Image Flow Matching

Flow matching has emerged as a powerful generative modeling approach with flexible choices of source distribution. While Gaussian distributions are commonly used, the potential for better alternatives in high-dimensional data generation remains largely unexplored. In this paper, we propose a novel 2D simulation that captures high-dimensional geometric properties in an interpretable 2D setting, enabling us to analyze the learning dynamics of flow matching during training. Based on this analysis, we derive several key insights about flow matching behavior: (1) density approximation can paradoxically degrade performance due to mode discrepancy, (2) directional alignment suffers from path entanglement when overly concentrated, (3) Gaussian's omnidirectional coverage ensures robust learning, and (4) norm misalignment incurs substantial learning costs. Building on these insights, we propose a practical framework that combines norm-aligned training with directionally-pruned sampling. This approach maintains the robust omnidirectional supervision essential for stable flow learning, while eliminating initializations in data-sparse regions during inference. Importantly, our pruning strategy can be applied to any flow matching model trained with a Gaussian source, providing immediate performance gains without the need for retraining. Empirical evaluations demonstrate consistent improvements in both generation quality and sampling efficiency. Our findings provide practical insights and guidelines for source distribution design and introduce a readily applicable technique for improving existing flow matching models. Our code is available at this https URL.

顶级标签: model training machine learning computer vision
详细标签: flow matching generative modeling source distribution sampling efficiency image generation 或 搜索:

是否存在比高斯分布更好的源分布?探索图像流匹配的源分布 / Is There a Better Source Distribution than Gaussian? Exploring Source Distributions for Image Flow Matching


1️⃣ 一句话总结

本文通过一个可解释的二维模拟实验,揭示了流匹配模型在训练中的关键动态,并基于此提出了一个结合范数对齐训练与方向性剪枝采样的实用框架,该框架能在不重新训练的情况下,直接提升现有基于高斯源分布的流匹配模型的生成质量和采样效率。

源自 arXiv: 2512.18184