Efficient Tracking and Understanding Object Transformations

arXiv:2607.19743v1 Announce Type: new Abstract: Tracking objects through state transformations is essential for understanding real-world dynamics. However, existing methods are computationally expensive. TubeletGraph recently showed impressive capabilities, but its inference cost (~4.4 seconds per object-frame on VOST) precludes any real-time deployment possibilities. We observe that TubeletGraph's overhead arises from building a spatiotemporal partition of the input video: (1) entity segmentation is computed densely for every frame regardless of whether a transformation occurs, and (2) every entity in the scene is tracked, scaling cost with scene complexity rather than the number of transformations of interest. To address both, we propose FluxGraph, a reactive variant that uses SAM2's internal multi-mask disagreement as a lightweight trigger for transformation detection, and removes the need for tracking all entities in the given video. FluxGraph is ~3.3imes faster than TubeletGraph on VOST while improving tracking performance and preserving state graph quality. Furthermore, we also observe consistent speedups of 3.7-10.7imes across VSCOS, M^3-VOS, and DAVIS17 while maintaining performance. Code is publicly available at https://github.com/YihongSun/FluxGraph.

Related

• Articulation in Prime: Primitive-Based Articulated Object Understanding from a Single Casual Video
• Radar-Informed 3D Multi-Object Tracking under Adverse Conditions
• GMOS: Grounding Moving Object Segmentation in 3D Space and Time
• VisionLaw: Inferring Interpretable Intrinsic Dynamics from Visual Observations via Bilevel Optimization
• OneViewAll: Semantic Prior Guided One-View 6D Pose Estimation for Novel Objects

Source: arXiv cs.CV | 2026-07-23