用于高质量基元神经重建的神经谐波纹理 / Neural Harmonic Textures for High-Quality Primitive Based Neural Reconstruction
1️⃣ 一句话总结
这项研究提出了一种名为‘神经谐波纹理’的新方法,通过在3D重建基元上添加周期性特征并利用小型神经网络解码,显著提升了实时新视角合成的细节表现和计算效率,同时兼容多种主流重建框架。
Primitive-based methods such as 3D Gaussian Splatting have recently become the state-of-the-art for novel-view synthesis and related reconstruction tasks. Compared to neural fields, these representations are more flexible, adaptive, and scale better to large scenes. However, the limited expressivity of individual primitives makes modeling high-frequency detail challenging. We introduce Neural Harmonic Textures, a neural representation approach that anchors latent feature vectors on a virtual scaffold surrounding each primitive. These features are interpolated within the primitive at ray intersection points. Inspired by Fourier analysis, we apply periodic activations to the interpolated features, turning alpha blending into a weighted sum of harmonic components. The resulting signal is then decoded in a single deferred pass using a small neural network, significantly reducing computational cost. Neural Harmonic Textures yield state-of-the-art results in real-time novel view synthesis while bridging the gap between primitive- and neural-field-based reconstruction. Our method integrates seamlessly into existing primitive-based pipelines such as 3DGUT, Triangle Splatting, and 2DGS. We further demonstrate its generality with applications to 2D image fitting and semantic reconstruction.
用于高质量基元神经重建的神经谐波纹理 / Neural Harmonic Textures for High-Quality Primitive Based Neural Reconstruction
这项研究提出了一种名为‘神经谐波纹理’的新方法,通过在3D重建基元上添加周期性特征并利用小型神经网络解码,显著提升了实时新视角合成的细节表现和计算效率,同时兼容多种主流重建框架。
源自 arXiv: 2604.01204