SAM-Body4D:无需训练即可从视频中恢复4D人体网格 / SAM-Body4D: Training-Free 4D Human Body Mesh Recovery from Videos
1️⃣ 一句话总结
这篇论文提出了一种无需额外训练的新方法,通过利用视频中人体运动的连续性,解决了现有技术从视频中重建3D人体姿态和形状时存在的时间不一致和遮挡问题,从而实现了更稳定和鲁棒的4D人体网格恢复。
Human Mesh Recovery (HMR) aims to reconstruct 3D human pose and shape from 2D observations and is fundamental to human-centric understanding in real-world scenarios. While recent image-based HMR methods such as SAM 3D Body achieve strong robustness on in-the-wild images, they rely on per-frame inference when applied to videos, leading to temporal inconsistency and degraded performance under occlusions. We address these issues without extra training by leveraging the inherent human continuity in videos. We propose SAM-Body4D, a training-free framework for temporally consistent and occlusion-robust HMR from videos. We first generate identity-consistent masklets using a promptable video segmentation model, then refine them with an Occlusion-Aware module to recover missing regions. The refined masklets guide SAM 3D Body to produce consistent full-body mesh trajectories, while a padding-based parallel strategy enables efficient multi-human inference. Experimental results demonstrate that SAM-Body4D achieves improved temporal stability and robustness in challenging in-the-wild videos, without any retraining. Our code and demo are available at: this https URL.
SAM-Body4D:无需训练即可从视频中恢复4D人体网格 / SAM-Body4D: Training-Free 4D Human Body Mesh Recovery from Videos
这篇论文提出了一种无需额外训练的新方法,通过利用视频中人体运动的连续性,解决了现有技术从视频中重建3D人体姿态和形状时存在的时间不一致和遮挡问题,从而实现了更稳定和鲁棒的4D人体网格恢复。
源自 arXiv: 2512.08406