DSG: Dynamic 3D Scene Graph Construction for Embodied Agents in Changing Indoor Environments

arXiv:2609.00619v1 Announce Type: new Abstract: In indoor environments, object positions frequently change due to human activities or embodied-agent interactions, causing previously constructed scene graphs to become inconsistent with the current scene. To address this issue, we propose DSG, a dynamic 3D scene graph construction framework that detects object changes and performs spatial relationship reasoning. First, we construct a semantic-aware 3D Gaussian scene representation and develop a dual-view rendering-based object change detection method to enable reliable scene graph node updates. Second, we propose a spatial relationship reasoning method that incorporates multi-granularity visual context, enabling a large language model to identify a richer set of interobject spatial relationships. Furthermore, we introduce DynTHOR, a dynamic indoor scene graph benchmark built on the AI2-THOR simulation platform for evaluating scene graph construction in dynamic environments. Extensive experiments on Dyn-THOR, 3RScan, and real-world scenes demonstrate that DSG consistently outperforms existing methods in both object node construction and spatial relationship reasoning, significantly improving the accuracy of dynamic scene graph construction.

Related

• CubifyGS: Object-Centric 3D Gaussian Splatting for Lifelong Dynamic Scene Maintenance
• Scene2Demo: Self-Evolving Embodied Data Generation via Object-Action Graph
• EmbodimentSemantic: A Spatial Scene-Graph Dataset and Benchmark for Vision-Language Models on Embodied Manipulation Trajectories
• Orchestrating Spatial Semantics via a Zone-Graph Paradigm for Intricate Indoor Scene Generation
• FOUND-IT: Foundation-model-first Task-driven 3D Scene Graphs with Granularity on Demand

Source: arXiv cs.RO | 2026-09-02