Safety
World Modeling through Spectral Alignment
arXiv:2610.15429v1 Announce Type: new Abstract: How do we tell a world model what information to preserve? We study this question through the lens of spectral representation learning. We introduce Spe
arXiv:2610.15429v1 Announce Type: new Abstract: How do we tell a world model what information to preserve? We study this question through the lens of spectral representation learning. We introduce SpecWM, a JEPA framework that explicitly specifies desired relationships between observations through a target similarity kernel and trains the encoder to reproduce those relationships in its embedding geometry. Different kernels provide different supervision, ranging from physical state information to a fully self-supervised temporal kernel requiring only the ordering of observations within trajectories. We characterize the global optima of the objective, establish conditions for linear recoverability and invariance to nuisance information, and connect temporal-kernel similarity to the behavioral successor measure under an idealized setting. Empirically, the choice of kernel strongly controls which physical quantities are recoverable from the representation. More importantly, temporal spectral alignment improves CEM planning success over LeWorldModel from 52% to 68% on OGBench Cube, 49% to 77% on OGBench Scene, and 29% to 51% on CALVIN. These results suggest that explicitly specifying representation geometry provides a simple way to steer what latent world models preserve for control.
Related
- When Do Conservation Laws Survive Learned Representations? Certified Horizons for Latent World Models
- Alignment-Sensitive Minimax Rates for Spectral Algorithms with Learned Kernels
- Sharp Rates and a One-Line Correction for Spectral Representation Learning
Source: arXiv cs.LG | 2026-10-14