身份感知的人体运动与身形联合生成 / IAM: Identity-Aware Human Motion and Shape Joint Generation
1️⃣ 一句话总结
本文提出了一种能同时生成人体运动与体型的AI模型,通过分析人的语言描述或视觉线索来识别其身体特征(如胖瘦、年龄),从而让生成的走路、跑步等动作看起来更符合该人物的真实体型和运动风格。
Recent advances in text-driven human motion generation enable models to synthesize realistic motion sequences from natural language descriptions. However, most existing approaches assume identity-neutral motion and generate movements using a canonical body representation, ignoring the strong influence of body morphology on motion dynamics. In practice, attributes such as body proportions, mass distribution, and age significantly affect how actions are performed, and neglecting this coupling often leads to physically inconsistent motions. We propose an identity-aware motion generation framework that explicitly models the relationship between body morphology and motion dynamics. Instead of relying on explicit geometric measurements, identity is represented using multimodal signals, including natural language descriptions and visual cues. We further introduce a joint motion-shape generation paradigm that simultaneously synthesizes motion sequences and body shape parameters, allowing identity cues to directly modulate motion dynamics. Extensive experiments on motion capture datasets and large-scale in-the-wild videos demonstrate improved motion realism and motion-identity consistency while maintaining high motion quality. Project page: this https URL
身份感知的人体运动与身形联合生成 / IAM: Identity-Aware Human Motion and Shape Joint Generation
本文提出了一种能同时生成人体运动与体型的AI模型,通过分析人的语言描述或视觉线索来识别其身体特征(如胖瘦、年龄),从而让生成的走路、跑步等动作看起来更符合该人物的真实体型和运动风格。
源自 arXiv: 2604.25164