A Semi-Automated Framework for 3D Reconstruction of Medieval Manuscript Miniatures

arXiv:2604.08610v1 Announce Type: new Abstract: This paper presents a semi-automated framework for transforming two-dimensional miniatures from medieval manuscripts into three-dimensional digital models suitable for extended reality (XR), tactile 3Dprinting, and web-based visualization. We evaluate seven image-to-3D methods (TripoSR, SF3D, SPAR3D, TRELLIS, Wonder3D, SAM3D, Hi3DGen) on 69manuscript figures from two collections using rendering-based metrics (Silhouette IoU, LPIPS, CLIPScore) and volumetric measures (Depth Range Ratio, watertight percentage), revealing a trade-off between volumetric expansion and geometric fidelity. Hi3DGen balances topological quality with rich surface detail through its normal bridging approach, making it a good starting point for expert refinement. Our pipeline combines SAM segmentation, Hi3DGen mesh generation, expert refinement in ZBrush, and AI-assisted texturing. Two case studies on Gothic illuminations from the Decretum Gratiani (Vatican Library) and Renaissance miniatures by Giulio Clovio demonstrate applicability across artistic traditions. The resulting models can support WebXR visualization, AR overlay on physical manuscripts, and tactile 3D~prints for visually impaired users.

Related

• Bag of Bags: Adaptive Visual Vocabularies for Genizah Join Image Retrieval
• HD-VGGT: High-Resolution Visual Geometry Transformer
• GEAR: GEometry-motion Alternating Refinement for Articulated Object Modeling with Gaussian Splatting
• A Geometric Algorithm for Blood Vessel Reconstruction from Skeletal Representation
• Structure-Aware Fine-Grained Gaussian Splatting for Expressive Avatar Reconstruction

Source: arXiv cs.CV | 2026-04-13