RDQ: Residual Distribution Quantization for Large Language Models
DGX agentarXiv:2607.10137v2 Announce Type: replace Abstract: Post-training quantization (PTQ) of large language models degrades sharply below 4-bit precision. We identify the root cause as residual stream dist