Colinearity Decay: Training Quantization-Friendly ViTs with Outlier Decay
arXiv:2605.01330v1 Announce Type: new Abstract: Low-bit quantization is a practical route for efficiently deploying vision Transformers, yet activation outliers complicate fully quantized deployment.