菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-01-15
📄 Abstract - FrankenMotion: Part-level Human Motion Generation and Composition

Human motion generation from text prompts has made remarkable progress in recent years. However, existing methods primarily rely on either sequence-level or action-level descriptions due to the absence of fine-grained, part-level motion annotations. This limits their controllability over individual body parts. In this work, we construct a high-quality motion dataset with atomic, temporally-aware part-level text annotations, leveraging the reasoning capabilities of large language models (LLMs). Unlike prior datasets that either provide synchronized part captions with fixed time segments or rely solely on global sequence labels, our dataset captures asynchronous and semantically distinct part movements at fine temporal resolution. Based on this dataset, we introduce a diffusion-based part-aware motion generation framework, namely FrankenMotion, where each body part is guided by its own temporally-structured textual prompt. This is, to our knowledge, the first work to provide atomic, temporally-aware part-level motion annotations and have a model that allows motion generation with both spatial (body part) and temporal (atomic action) control. Experiments demonstrate that FrankenMotion outperforms all previous baseline models adapted and retrained for our setting, and our model can compose motions unseen during training. Our code and dataset will be publicly available upon publication.

顶级标签: natural language processing computer vision multi-modal
详细标签: human motion generation text-to-motion diffusion models fine-grained annotation part-level control 或 搜索:

弗兰肯运动:基于身体部位的人体运动生成与组合 / FrankenMotion: Part-level Human Motion Generation and Composition


1️⃣ 一句话总结

这篇论文提出了一个名为FrankenMotion的新方法,它通过构建一个带有精细时间标注的身体部位运动数据集,并基于此开发了一个扩散模型,首次实现了用户能像拼积木一样,分别控制人体不同部位在不同时间点的动作来生成复杂、可控的全身运动。

源自 arXiv: 2601.10909