条件生成模型的最优混合专家模型平均方法 / Optimal Mixture-of-Experts Model Averaging for Conditional Generative Models
1️⃣ 一句话总结
本文提出了一种针对条件生成模型的最优模型平均框架,既能通过静态权重组合多个生成器(StaticMA),也能根据输入条件动态调整权重(MoEMA),在无需模型概率密度的情况下仅利用生成样本即可提升生成质量,并在表格、图像和文本数据上均优于现有方法。
Conditional generative models have emerged as powerful tools for sampling from target conditional distributions, driving substantial advances across a wide range of scientific and applied domains. As these models proliferate, practitioners often face multiple plausible generators whose performance can vary with the task, data, or input condition. We propose an optimal model averaging framework for conditional generative models, allowing candidate generators to be combined even when they are accessible only through conditional samples without tractable densities. Specifically, we use a sample-based maximum mean discrepancy between conditional distributions, which first leads to a static model averaging method, StaticMA, assigning fixed weights to different candidates. In addition, we develop MoEMA (mixture-of-experts model averaging), an input-adaptive method that parameterizes covariate-dependent weights through a softmax neural-network gate. We establish in-sample and out-of-sample asymptotic optimality for the proposed methods, together with consistency of the estimated adaptive weight function under regularity conditions. The framework applies directly to Euclidean responses and extends to unstructured data by combining our formulation with fixed representation maps. Across a broad set of simulations and real-data studies spanning tabular, image, and text modalities, MoEMA generally improves over competing baselines, demonstrating the effectiveness of our proposed methods.
条件生成模型的最优混合专家模型平均方法 / Optimal Mixture-of-Experts Model Averaging for Conditional Generative Models
本文提出了一种针对条件生成模型的最优模型平均框架,既能通过静态权重组合多个生成器(StaticMA),也能根据输入条件动态调整权重(MoEMA),在无需模型概率密度的情况下仅利用生成样本即可提升生成质量,并在表格、图像和文本数据上均优于现有方法。
源自 arXiv: 2607.04360