Sparse but Wrong: Incorrect L0 Leads to Incorrect Features in Sparse Autoencoders
arXiv:2508.16560v4 Announce Type: replace-cross Abstract: Sparse Autoencoders (SAEs) extract features from LLM internal activations, meant to correspond to interpretable concepts. A core SAE training