Predictive Objectives Discard Exogenous Control-Relevant Features: A Controlled Mechanistic Study
arXiv:2606.30068v1 Announce Type: new Abstract: Joint-embedding predictive (JEPA-style) objectives learn representations by predicting future latents. In doing so they can discard features that are ex