MSGS: Multispectral 3D Gaussian Splatting

arXiv:2604.13340v1 Announce Type: new Abstract: We present a multispectral extension to 3D Gaussian Splatting (3DGS) for wavelength-aware view synthesis. Each Gaussian is augmented with spectral radiance, represented via per-band spherical harmonics, and optimized under a dual-loss supervision scheme combining RGB and multispectral signals. To improve rendering fidelity, we perform spectral-to-RGB conversion at the pixel level, allowing richer spectral cues to be retained during optimization. Our method is evaluated on both public and self-captured real-world datasets, demonstrating consistent improvements over the RGB-only 3DGS baseline in terms of image quality and spectral consistency. Notably, it excels in challenging scenes involving translucent materials and anisotropic reflections. The proposed approach maintains the compactness and real-time efficiency of 3DGS while laying the foundation for future integration with physically based shading models.

Related

• ArtifactWorld: Scaling 3D Gaussian Splatting Artifact Restoration via Video Generation Models
• PDF-GS: Progressive Distractor Filtering for Robust 3D Gaussian Splatting
• MedGS: Gaussian Splatting for Multi-Modal 3D Medical Imaging
• Realizing Immersive Volumetric Video: A Multimodal Framework for 6-DoF VR Engagement
• Feed-Forward 3D Scene Modeling: A Problem-Driven Perspective
• Efficient Transceiver Design for Aerial Image Transmission and Large-scale Scene Reconstruction

Source: arXiv cs.CV | 2026-04-16