菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-06-22
📄 Abstract - Policy-as-Data: Learning Generalizable HOI Diffusion Models from Simulated Physics

Synthesizing realistic Human-Object Interactions (HOI) is critical for creating embodied avatars and functional virtual environments. However, current data-driven approaches primarily rely on motion capture datasets, which are expensive to scale and limited in functional diversity. Models trained with these datasets fail to generalize to unseen objects and maintain physical consistency over long horizons. In this paper, we propose a novel framework that leverages a physics simulator to overcome the data-scarcity bottleneck in HOI generation. Specifically, we propose a scalable pipeline, called \ours, which leverages policies trained with reinforcement learning in a physics simulator for task-oriented data generation and trains a generative model on the augmented dataset for generalizable HOI generation. To seamlessly utilize the synthetic data, we introduce a coarse-to-fine retargeting process that bridges the representation gap between the simplified model used in physics simulator and the standard parametric body models required for generative training. Validated through comprehensive experiments, our method demonstrates enhanced generalization to unseen objects and the capability of long-horizon generation, while exhibiting greater dynamic diversity and physical plausibility.

顶级标签: computer vision reinforcement learning generation
详细标签: human-object interaction physics simulation data augmentation motion generation diffusion model 或 搜索:

策略即数据:从物理仿真中学习可泛化的人-物交互扩散模型 / Policy-as-Data: Learning Generalizable HOI Diffusion Models from Simulated Physics


1️⃣ 一句话总结

本文提出了一种新方法,通过物理仿真器中的强化学习策略生成大量高质量的人-物交互数据,并训练扩散模型,从而解决了真实数据稀缺导致的泛化性差和物理不一致问题,使生成的交互动作能适应新物体并保持长期真实感。

源自 arXiv: 2606.22806