AAAC: Activation-Aware Adaptive Codebooks for 4-bit LLM Weight Quantization
DGX agentarXiv:2605.08692v1 Announce Type: cross Abstract: Post-training weight-only quantization to 4 bits is widely used to reduce the memory and compute costs of large language model inference. Existing PTQ