Quantization-Aware Healing: A Practical Recipe for Recovering Compressed, 4-Bit LLMs
DGX agentarXiv:2608.20953v1 Announce Type: cross Abstract: Serving large language models cheaply increasingly means shipping models that are both structurally compressed to a fraction of their parameters and q