迈向解耦3D高斯泼溅优化的一步 / A Step to Decouple Optimization in 3DGS
1️⃣ 一句话总结
这篇论文发现并解决了当前3D高斯泼溅技术中优化过程存在的耦合问题,通过解耦和重组优化步骤,最终提出了一种名为AdamW-GS的新优化方法,在提升训练效率的同时获得了更好的3D场景重建效果。
3D Gaussian Splatting (3DGS) has emerged as a powerful technique for real-time novel view synthesis. As an explicit representation optimized through gradient propagation among primitives, optimization widely accepted in deep neural networks (DNNs) is actually adopted in 3DGS, such as synchronous weight updating and Adam with the adaptive gradient. However, considering the physical significance and specific design in 3DGS, there are two overlooked details in the optimization of 3DGS: (i) update step coupling, which induces optimizer state rescaling and costly attribute updates outside the viewpoints, and (ii) gradient coupling in the moment, which may lead to under- or over-effective regularization. Nevertheless, such a complex coupling is under-explored. After revisiting the optimization of 3DGS, we take a step to decouple it and recompose the process into: Sparse Adam, Re-State Regularization and Decoupled Attribute Regularization. Taking a large number of experiments under the 3DGS and 3DGS-MCMC frameworks, our work provides a deeper understanding of these components. Finally, based on the empirical analysis, we re-design the optimization and propose AdamW-GS by re-coupling the beneficial components, under which better optimization efficiency and representation effectiveness are achieved simultaneously.
迈向解耦3D高斯泼溅优化的一步 / A Step to Decouple Optimization in 3DGS
这篇论文发现并解决了当前3D高斯泼溅技术中优化过程存在的耦合问题,通过解耦和重组优化步骤,最终提出了一种名为AdamW-GS的新优化方法,在提升训练效率的同时获得了更好的3D场景重建效果。
源自 arXiv: 2601.16736