SkelGen4D:基于弱监督骨骼的文本驱动网格动画4D生成 / SkelGen4D: Weakly-Supervised Skeleton-Based 4D Generation for Text-Driven Mesh Animation
1️⃣ 一句话总结
本文提出一种名为SkelGen4D的方法,能够根据文字描述自动生成3D模型的骨骼动画,无需人工标注每帧骨骼位置,并通过弱监督学习生成时间连贯、物理合理的动作,方便用户后期编辑和直接用于标准动画制作流程。
We study 4D generation to synthesize temporally coherent sequences of 3D geometry for animation and content creation. In contrast to existing SDS-based optimization methods and video-driven animation approaches, we adopt a skeleton-driven animation framework aligned with standard industrial pipelines, which enables explicit control and editing. To this end, we propose SkelGen4D, a weakly supervised feed-forward framework for text-driven mesh animation that generates explicit skeleton motions without requiring per-frame skeleton annotations. SkelGen4D first recovers temporally consistent pseudo-skeletons from animated meshes via differentiable fitting, and then generates text-conditioned skeleton motion sequences in a feed-forward manner, further refined with Motion-GRPO to ensure temporally coherent, physically plausible, and articulated animation. We evaluate our method on two large-scale benchmarks, Truebones Zoo and Diffusion4D. Our results show that our weakly supervised skeleton modeling matches or surpasses fully supervised baselines while scaling to diverse object categories for high-quality text-driven mesh animation. Further, our method supports flexible motion editing and is aligned with standard animation production pipelines.
SkelGen4D:基于弱监督骨骼的文本驱动网格动画4D生成 / SkelGen4D: Weakly-Supervised Skeleton-Based 4D Generation for Text-Driven Mesh Animation
本文提出一种名为SkelGen4D的方法,能够根据文字描述自动生成3D模型的骨骼动画,无需人工标注每帧骨骼位置,并通过弱监督学习生成时间连贯、物理合理的动作,方便用户后期编辑和直接用于标准动画制作流程。
源自 arXiv: 2607.08246