📄
Abstract - Splannequin: Freezing Monocular Mannequin-Challenge Footage with Dual-Detection Splatting
Synthesizing high-fidelity frozen 3D scenes from monocular Mannequin-Challenge (MC) videos is a unique problem distinct from standard dynamic scene reconstruction. Instead of focusing on modeling motion, our goal is to create a frozen scene while strategically preserving subtle dynamics to enable user-controlled instant selection. To achieve this, we introduce a novel application of dynamic Gaussian splatting: the scene is modeled dynamically, which retains nearby temporal variation, and a static scene is rendered by fixing the model's time parameter. However, under this usage, monocular capture with sparse temporal supervision introduces artifacts like ghosting and blur for Gaussians that become unobserved or occluded at weakly supervised timestamps. We propose Splannequin, an architecture-agnostic regularization that detects two states of Gaussian primitives, hidden and defective, and applies temporal anchoring. Under predominantly forward camera motion, hidden states are anchored to their recent well-observed past states, while defective states are anchored to future states with stronger supervision. Our method integrates into existing dynamic Gaussian pipelines via simple loss terms, requires no architectural changes, and adds zero inference overhead. This results in markedly improved visual quality, enabling high-fidelity, user-selectable frozen-time renderings, validated by a 96% user preference. Project page: this https URL
Splannequin:通过双重检测的溅射技术冻结单目人体模型挑战视频 /
Splannequin: Freezing Monocular Mannequin-Challenge Footage with Dual-Detection Splatting
1️⃣ 一句话总结
这篇论文提出了一种名为Splannequin的新方法,它通过检测和锚定动态高斯模型中‘隐藏’和‘缺陷’的两种状态,有效解决了从单角度拍摄的动态视频中合成高质量、用户可选择‘时间冻结’3D场景时出现的鬼影和模糊问题,且无需改变现有模型结构或增加额外计算开销。