The Orthogonalized Read Is a Removable Training Scaffold for Recurrent Memory
DGX agentarXiv:2607.19390v1 Announce Type: new Abstract: A recent report finds that orthogonalizing the mLSTM memory matrix at read time (five Newton-Schulz iterations, trained through) substantially improves