FlowAvatar: Real-Time Full-Body Avatars from Sparse Egocentric Inputs on Consumer XR Devices

arXiv:2610.16277v1 Announce Type: new Abstract: Prior avatar embodiment research has studied tracking completeness (how faithfully the body, hands, and face are sensed and reproduced) and personalized appearance in isolation, each requiring specialized lab equipment. How these factors interact on consumer hardware remains an open question, because no existing system unifies body pose, face, hands, and personalized appearance on a standalone headset. We present FlowAvatar, a system enabling real-time personalized look-alike avatars with full-body pose, hand articulation, facial expression, and eye gaze tracking from sparse egocentric inputs on consumer XR devices (Meta Quest Pro). Our pose model achieves competitive spatial accuracy and state-of-the-art temporal consistency on the AMASS benchmark against prior works with comprehensive spatial and temporal losses validated through architecture and loss ablations, while running in real-time. Two user studies (N=12, N=10) provide converging evidence that tracking completeness and personalized appearance serve complementary roles: tracking completeness broadly improves perceived motion quality, while only their combination achieves positive total embodiment.

Related

• Reliability-Gated Fusion of Consumer Head and Foot IMUs for Lower-Body 3D Pose
• Avatar-Forever: Decoupled Parallel Training for High-Quality Real-Time Infinite Avatars
• Live Avatar: Streaming Real-time Audio-Driven Avatar Generation with Infinite Length
• OmniFit: Multi-modal 3D Body Fitting via Scale-agnostic Dense Landmark Prediction
• RealDenseFace: Real-time Monocular 3D Face Reconstruction from Dense UV-space Priors

Source: arXiv cs.CV | 2026-10-14