StagQ: Constraint-Driven Multi-Precision Weight Quantization for LLMs
DGX agentarXiv:2610.05977v1 Announce Type: new Abstract: Serving a large language model (LLM) across a fleet of deployments requires several weight-precision operating points. Multi-precision formats serve the