菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-03-26
📄 Abstract - A CDF-First Framework for Free-Form Density Estimation

Conditional density estimation (CDE) is a fundamental task in machine learning that aims to model the full conditional law $\mathbb{P}(\mathbf{y} \mid \mathbf{x})$, beyond mere point prediction (e.g., mean, mode). A core challenge is free-form density estimation, capturing distributions that exhibit multimodality, asymmetry, or topological complexity without restrictive assumptions. However, prevailing methods typically estimate the probability density function (PDF) directly, which is mathematically ill-posed: differentiating the empirical distribution amplifies random fluctuations inherent in finite datasets, necessitating strong inductive biases that limit expressivity and fail when violated. We propose a CDF-first framework that circumvents this issue by estimating the cumulative distribution function (CDF), a stable and well-posed target, and then recovering the PDF via differentiation of the learned smooth CDF. Parameterizing the CDF with a Smooth Min-Max (SMM) network, our framework guarantees valid PDFs by construction, enables tractable approximate likelihood training, and preserves complex distributional shapes. For multivariate outputs, we use an autoregressive decomposition with SMM factors. Experiments demonstrate our approach outperforms state-of-the-art density estimators on a range of univariate and multivariate tasks.

顶级标签: machine learning model training theory
详细标签: conditional density estimation cumulative distribution function free-form density autoregressive decomposition smooth min-max network 或 搜索:

一种基于累积分布函数优先的自由形式密度估计框架 / A CDF-First Framework for Free-Form Density Estimation


1️⃣ 一句话总结

这篇论文提出了一种新的密度估计方法,它通过先稳定地学习累积分布函数,再求导得到概率密度,从而能更准确地捕捉数据中复杂的多峰、不对称等分布形态,避免了传统直接估计概率密度方法的缺陷。

源自 arXiv: 2603.25204