Self-Supervised Slice-to-Volume Reconstruction with Gaussian Representations for Fetal MRI

arXiv:2601.22990v2 Announce Type: replace-cross Abstract: Reconstructing 3D fetal MR volumes from motion-corrupted stacks of 2D slices is a crucial and challenging task. Conventional slice-to-volume reconstruction (SVR) methods are time-consuming and require multiple orthogonal stacks for reconstruction. While learning-based SVR approaches have significantly reduced the time required at the inference stage, they heavily rely on ground truth information for training, which is inaccessible in practice. To address these challenges, we propose GaussianSVR, a self-supervised framework for slice-to-volume reconstruction. GaussianSVR represents the target volume using 3D Gaussian representations to achieve high-fidelity reconstruction. It leverages a simulated forward slice acquisition model to enable self-supervised training, alleviating the need for ground-truth volumes. Furthermore, to enhance both accuracy and efficiency, we introduce a multi-resolution training strategy that jointly optimizes Gaussian parameters and spatial transformations across different resolution levels. Experiments show that GaussianSVR outperforms the baseline methods on fetal MR volumetric reconstruction. Code is available at https://github.com/Yinsong0510/GaussianSVR-Self-Supervised-Slice-to-Volume-Reconstruction-with-Gaussian-Representations.

Related

• Neural Harmonic Textures for High-Quality Primitive Based Neural Reconstruction
• RAM: Recover Any 3D Human Motion in-the-Wild
• PlaneCycle: Training-Free 2D-to-3D Lifting of Foundation Models Without Adapters
• Deep Learning-Based Tracking and Lineage Reconstruction of Ligament Breakup
• From Navigation to Refinement: Revealing the Two-Stage Nature of Flow-based Diffusion Models through Oracle Velocity

Source: arXiv cs.AI | 2026-04-13