ForeSplat:面向前馈式3D高斯溅射的优化感知预判方法 / ForeSplat: Optimization-Aware Foresight for Feed-Forward 3D Gaussian Splatting
1️⃣ 一句话总结
本文提出一种名为ForeSplat的训练框架,通过让前馈式3D高斯溅射模型在训练时就考虑后续优化过程,使其生成的初始场景更适合快速精调,从而在不增加推理成本的情况下,用更少的迭代步骤就能达到甚至超越传统逐场景优化的重建质量。
Feed-forward 3D Gaussian Splatting (3DGS) models offer fast single-pass reconstruction,but scaling them to match per-scene optimization quality is fundamentally hindered by the scarcity of large-scale 3D annotations.A practical compromise is predict-then-refine,where post-prediction optimization compensates for the limited capacity of the feed-forward this http URL,standard feed-forward 3DGS is trained solely for zero-step rendering error,ignoring whether its output constitutes a good initialization for the downstream this http URL present ForeSplat,an optimization-aware training framework that equips feed-forward 3DGS models to produce initializations explicitly designed for rapid,effective this http URL offloading part of the scene-modeling burden to the optimizer,ForeSplat substantially reduces the capacity pressure on the feed-forward model,making high-quality reconstruction feasible even with compact this http URL its core is MetaGrad,a lightweight multi-anchor meta-gradient training rule that bypasses costly higher-order differentiation through the 3DGS this http URL unrolls a short inner-loop refinement trajectory,samples anchor states,and back-propagates aggregated first-order gradients to the prediction head as a surrogate optimization-aware this http URL fine-tuning adds no inference cost and enables high-quality reconstruction within seconds after a few refinement this http URL instantiate ForeSplat on diverse backbones,including AnySplat,Pi3X,and a distilled variant tailored for edge this http URL all tested architectures,a ForeSplat-trained initialization converges in fewer refinement steps and reaches a higher peak reconstruction quality than its vanilla counterpart,even fully this http URL framework consistently bridges the gap between amortized prediction and per-scene optimization,establishing a practical path toward lightweight,high-fidelity 3D reconstruction.
ForeSplat:面向前馈式3D高斯溅射的优化感知预判方法 / ForeSplat: Optimization-Aware Foresight for Feed-Forward 3D Gaussian Splatting
本文提出一种名为ForeSplat的训练框架,通过让前馈式3D高斯溅射模型在训练时就考虑后续优化过程,使其生成的初始场景更适合快速精调,从而在不增加推理成本的情况下,用更少的迭代步骤就能达到甚至超越传统逐场景优化的重建质量。
源自 arXiv: 2605.22020