Group-Invariant Statistics Determine Embedding Geometry: Harmonic Analysis of Representations from Bach to the Night Sky
DGX agentarXiv:2610.00647v1 Announce Type: new Abstract: The representations that language models learn for concepts such as months, weekdays, and places display consistent geometric structure: circles and sad