菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-07-07
📄 Abstract - Retrieving and Refining Winning Noise Tickets for Diffusion-Based Motion Generation

Diffusion-based text-to-motion models synthesize realistic human motions but often exhibit semantic drift from the input text. Motion is inherently temporal, especially in compositional and long-duration sequences that require semantic consistency across multiple action segments and smooth kinematic transitions throughout the trajectory. We posit that the initial noise is central to this consistency: within the Gaussian noise space, certain instances, i.e. winning noise tickets, carry latent structure that biases denoising toward particular motion semantics, even under null prompts. We propose WInning Noise Retrieval and Optimization (WINRO), a training-free, model-agnostic framework that improves text-motion alignment by selecting and refining such tickets before diffusion sampling. WINRO maps random noises to motion features generated under null prompts, retrieves the best-aligned noise for a given text, and refines it via a KL-regularized objective that reduces the residual semantic gap while preserving the Gaussian prior. An optional LoRA-based adapter amortizes this refinement into a single forward pass. WINRO consistently improves text-motion fidelity across different base models, MDM and MotionLCM, on HumanML3D without retraining, improves temporal robustness on the MTT benchmark, and generalizes to applications such as motion stylization and spatial constraint satisfaction.

顶级标签: machine learning computer vision
详细标签: text-to-motion noise optimization diffusion models motion generation semantic alignment 或 搜索:

检索与精炼优胜噪声票:用于扩散模型驱动的动作生成 / Retrieving and Refining Winning Noise Tickets for Diffusion-Based Motion Generation


1️⃣ 一句话总结

本文提出一种无需重新训练的方法,通过自动从随机噪声中筛选出与文本描述最匹配的“优胜噪声票”,并对其进行微调,从而显著提升扩散模型生成人体动作的语义准确性和时间连贯性。

源自 arXiv: 2607.06843