MoBiQuant: Mixture-of-Bits Quantization for Token-Adaptive Any-Precision LLM
DGX agentarXiv:2602.20191v2 Announce Type: replace-cross Abstract: Dynamic runtime latency and memory constraints necessitate flexible large language model (LLM) deployment, where an LLM can be inferred with v