From Attention Sensitivity to Layer Role: Revisiting Mixed-Precision Quantization of Transformers
arXiv:2609.34866v1 Announce Type: new Abstract: Most post-training quantization pipelines fit each weight matrix to its pretrained counterpart, one matrix at a time. Whether that proxy tracks what an