GaugeQuant: Online Learning of Quantization-Optimal Bases from LLM Symmetries
DGX agentarXiv:2607.20757v1 Announce Type: cross Abstract: Transformers are known to have internal continuous symmetries that leave outputs invariant, while modifying quantization. GaugeQuant leverages this in