Embracing Anisotropy: Turning Massive Activations into Interpretable Control Knobs for Large Language Models
DGX agentarXiv:2603.00029v2 Announce Type: replace Abstract: Large Language Models (LLMs) exhibit highly anisotropic internal representations, often characterized by massive activations, a phenomenon where a s