Local Ai
ProPhy: Progressive Physical Alignment for Dynamic World Simulation
arXiv:2512.05564v2 Announce Type: replace Abstract: Recent advances in video generation have shown remarkable potential for constructing world simulators. However, current models still struggle to pro
arXiv:2512.05564v2 Announce Type: replace Abstract: Recent advances in video generation have shown remarkable potential for constructing world simulators. However, current models still struggle to produce physically consistent results, particularly when handling large-scale or complex dynamics. This limitation arises primarily because existing approaches respond isotropically to physical prompts and neglect the fine-grained alignment between generated content and localized physical cues. To address these challenges, we propose ProPhy, a Progressive Physical Alignment Framework that enables explicit physics-aware conditioning and anisotropic generation. ProPhy employs a two-stage Mixture-of-Physics-Experts mechanism for discriminative physical prior extraction, where Semantic Experts infer semantic-level physical principles from textual descriptions, and Refinement Experts capture token-level physical dynamics. This mechanism allows the model to learn fine-grained, physics-aware video representations that better reflect underlying physical laws. Furthermore, we introduce a physical alignment strategy that transfers the physical reasoning capabilities of vision-language models into the Refinement Experts, facilitating a more accurate representation of dynamic physical phenomena. Extensive experiments on physics-aware video generation benchmarks demonstrate that ProPhy produces more realistic, dynamic, and physically coherent results than existing state-of-the-art methods.
Related
- Phantom: Physics-Infused Video Generation via Joint Modeling of Visual and Latent Physical Dynamics
- Long-Horizon Streaming Video Generation via Hybrid Attention with Decoupled Distillation
- MotionScape: A Large-Scale Real-World Highly Dynamic UAV Video Dataset for World Models
- Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory
- Mind the Generative Details: Direct Localized Detail Preference Optimization for Video Diffusion Models
Source: arXiv cs.CV | 2026-04-14