Model Releases
RASA: Disentangled Spatial-Motional Priors for Cross-Identity Character Animation
arXiv:2608.28219v1 Announce Type: new Abstract: Cross-identity character animation aims to drive a target identity from a reference image to follow the motion of a source character from a driving vide
arXiv:2608.28219v1 Announce Type: new Abstract: Cross-identity character animation aims to drive a target identity from a reference image to follow the motion of a source character from a driving video. The core challenge lies in the inherent entanglement of two capabilities: cross-identity spatial mapping (aligning position, scale, and skeletal proportions) and motion control (refining joint articulation, volumetric consistency, and view coherence). We introduce Reference-Aware Structural Alignment (RASA), a framework that disentangles spatial mapping from motion control by injecting structured priors into a Diffusion Transformer (DiT). Our approach has two stages. First, a Spatial Prior Calibrator (SPC) fuses reference identity with driving pose to generate a spatially grounded initial noise latent, ensuring correct positioning, scaling, and alignment with the driving skeleton. Second, an Inherent Motional Guider (IMG) encodes shape-agnostic SMPL articulation parameters into a semantic motion vector beyond appearance-biased 2D keypoints. Injected into intermediate DiT layers, this vector complements the base pose condition for anatomically consistent articulation and view-aware volumetric refinement. We curate CIM-Bench, a high-quality benchmark with rigorous curation, for evaluation. Extensive experiments show RASA significantly outperforms state-of-the-art methods in motion fidelity and visual quality. Our work establishes a new paradigm showing disentangled spatial and motional priors are key to robust character animation. Project page: https://hidream.ai.github.io/RASA/
Related
- SCAIL-2: Unifying Controlled Character Animation with End-to-end In-Context Conditioning
- LiveAnimate: Stable Long-Form Streaming Human Animation in Real-Time
- 3D Scene-Adaptive Trajectory-Controllable Human Image Animation with Camera Movement
- SteadyDancer: Harmonized and Coherent Human Image Animation with First-Frame Preservation
Source: arXiv cs.CV | 2026-08-31