HumanPhys: A Human-Centric Physical-World Perception Benchmark for Real-World Visual Reasoning

arXiv:2610.14679v1 Announce Type: new Abstract: We introduce HumanPhys, a human-centric benchmark for real-world physical perception, and a training corpus emitted by the same pipeline. Each question targets a physically grounded quantity related to people, including depth, inter-person distance, gaze angle, displacement, velocity, heading-step trajectory, blink count, and contact-deformation strength. The rendered probes additionally test illumination inference from body and face cues and camera ego-motion, both with and without a person in the frame. All labels are derived programmatically from sensor calibration, source metadata, or renderer state, rather than written by annotators or produced by estimators on the benchmark frames. HumanPhys systematically probes six dimensions of human-centric physical perception: spatial state, kinematics, blink events, deformation, illumination, and camera pose. To the best of our knowledge, no existing MLLM benchmark-and-training corpus jointly supervises this set of human-centered physical quantities under direct metadata- or renderer-derived labels. The six dimensions appear only partially dissociable across the tested MLLMs. We benchmark a range of open- and closed-source MLLMs on HumanPhys and find that all six capability dimensions remain challenging for current models. We hope HumanPhys will support future research on multimodal systems that perceive and reason about people in the physical world.

Related

• PerceptionRubrics: Calibrating Multimodal Evaluation to Human Perception
• JRDB-AVR: An Active Visual Reasoning Benchmark for Embodied Agents in Real-World Environments
• MHPR: Multidimensional Human Perception and Reasoning Benchmark for Large Vision-Languate Models
• SAW-Bench: Learning Situated Awareness in the Real World

Source: arXiv cs.CV | 2026-10-14