Agents
R2RI: A Multi-View Event and RGB Dataset for Robot-to-Robot Interaction
arXiv:2610.07117v1 Announce Type: new Abstract: Understanding and modeling interactions between autonomous agents is a fundamental challenge in robotics, with broad implications for collaborative syst
arXiv:2610.07117v1 Announce Type: new Abstract: Understanding and modeling interactions between autonomous agents is a fundamental challenge in robotics, with broad implications for collaborative systems, social robotics, and human-robot coexistence. Although the study of robot interactions has emerged as a compelling research direction, progress has been severely hampered by the absence of large-scale benchmarks. In this paper, we introduce Robot-to-Robot Interaction (R2RI), the first dataset specifically designed to address the Robot-Robot Interaction (RRI) task. R2RI consists of different humanoid robots and realistic interactions modeled on real human social behaviors. Complementary viewpoints are available, extit{i.e.}, an egocentric perspective from each robot's onboard sensors, and an exocentric perspective from external fixed cameras, thus enabling rich spatial and contextual understanding of the interaction dynamics. The dataset comprises more than 6.5M frames and approx5000 videos at 120 fps, including Event and RGB domains. We investigate pros and cons of each domain, comparing state-of-the-art approaches for a number of key sensing and interaction based tasks. We publicly release the dataset and its annotations for all tasks and modalities at https://github.com/MagriniGabriele/R2RI.
Related
- Recursive Harness Distillation across Agents for Robot Manipulation
- Dense Coverage, Sparse Refinement: Byte-Constrained Cooperative Perception
- ViCo3D: Empowering LiDAR-based Collaborative 3D Object Detection with Vision Foundation Models
- MultiWorld: Scalable Multi-Agent Multi-View Video World Models
Source: arXiv cs.CV | 2026-10-07