Attention-Based Surface Representation Learning for Robot State Prediction and Open-Ended Surface Classification

arXiv:2610.04240v1 Announce Type: cross Abstract: For ground robots operating in outdoor environments, understanding the properties of the underlying terrain is essential for ensuring reliable operation. In most perception-based studies, this problem is formulated as categorical classification with a fixed number of classes defined during training. We propose an approach that enables new surface classes to be added as trainable vectors, which can subsequently be used to address higher-level tasks. By employing a learning paradigm based on predicting the robot's next state in time and using attention blocks, we improved classification accuracy to 98.56% on the Belyaev-Kushnarev dataset and 94.8% on BorealTC.

Multi-layer Cross-Attention is Provably Optimal for Multi-modal In-context Learning
Machine Learning-based Feedback Linearization Control of Quadrotor Subject to Unmodeled Dynamics
Beyond One-Step Accuracy: State-Affine Latent Transition for Reliable Visual Planning

Source: arXiv cs.LG | 2026-10-06

Related