Compressed Computation under L^4 Loss is likely Computation in Superposition
arXiv:2607.04800v1 Announce Type: new Abstract: Neural networks are thought to represent concepts as directions in their activation space, and superposition lets them encode more concepts than they ha