Toward a First-Principles Update Geometry for the Language-Model Head
DGX agentarXiv:2608.22253v1 Announce Type: new Abstract: We study the language-model head and softmax as a single module, deriving an update geometry from their composition rather than from the weight matrix i