Research
CatPortrait: Taming Video Generative Models for Portrait Animation via In-context Conditioning
arXiv:2610.14957v1 Announce Type: new Abstract: Recent video generative models have shown strong capability in synthesizing high-quality and temporally coherent videos. Yet, adapting them for controll
arXiv:2610.14957v1 Announce Type: new Abstract: Recent video generative models have shown strong capability in synthesizing high-quality and temporally coherent videos. Yet, adapting them for controllable portrait animation remains nontrivial, as existing methods typically rely on architectural changes or extra conditioning modules, increasing complexity and reducing compatibility with pretrained models. We present CatPortrait, a simple and effective framework that enables controllable portrait animation via 3D face guidance as in-context conditioning. CatPortrait preserves the original video generation backbone and injects structured 3D facial guidance into the input space through spatial concatenation, allowing pretrained image-to-video models to animate portraits without sacrificing their pretrained priors. CatPortrait supports both video-driven and audio-driven portrait animation within a unified framework. Extensive experiments demonstrate that CatPortrait achieves competitive or superior results across both settings.
Related
- AniCrafter: Customizing Realistic Human-Centric Animation via Avatar-Background Conditioning in Video Diffusion Models
- JoyVASA: Portrait and Animal Image Animation with Diffusion-Based Audio-Driven Facial Dynamics and Head Motion Generation
- PoseGen: In-Context LoRA Finetuning for Pose-Controllable Long Human Video Generation
Source: arXiv cs.CV | 2026-10-14