Safety
MotionHiFlow: Text-to-motion via hierarchical flow matching
arXiv:2604.23264v1 Announce Type: new Abstract: Text-to-motion generation aims to generate 3D human motions that are tightly aligned with the input text while remaining physically plausible and rich i
arXiv:2604.23264v1 Announce Type: new Abstract: Text-to-motion generation aims to generate 3D human motions that are tightly aligned with the input text while remaining physically plausible and rich in fine-grained detail. Although recent approaches can produce complex and natural movements, they usually operate at only one temporal scale, which limits both semantic alignment and temporal coherence. Inspired by the fact that complex motions are conceptualized hierarchically rather than at a single temporal scale in the human cognitive system, we propose extit{MotionHiFlow}, a hierarchical flow matching framework to generate motion progressively by constructing flow path from low to high temporal scales. The flows at lower scales capture high-level semantics and coarse motion structures, while flows at higher scales refine temporal details. To link the flows across scales, we introduce a novel cross-scale transition process, ensuring continuity and preserving noise consistency. Furthermore, by integrating a Text-Motion Diffusion Transformer and a topology-aware Motion VAE, MotionHiFlow explicitly models structural dependencies among joints via joint-aware positional encoding and skeletal topology, enabling precise semantic alignment alongside fine-grained motion details. Extensive experiments on HumanML3D and KIT-ML benchmarks demonstrate state-of-the-art performance, with ablation studies confirming the effectiveness of the hierarchical design and key components. Code is available at https://github.com/ai-lh/MotionHiFlow.
Related
- Reward Score Matching: Unifying Reward-based Fine-tuning for Flow and Diffusion Models
- LeapAlign: Post-Training Flow Matching Models at Any Generation Step by Building Two-Step Trajectories
- Encoder-Free Human Motion Understanding via Structured Motion Descriptions
- THOM: Generating Physically Plausible Hand-Object Meshes From Text
- World-R1: Reinforcing 3D Constraints for Text-to-Video Generation
Source: arXiv cs.CV | 2026-04-28