ARCQuant: Boosting NVFP4 Quantization with Augmented Residual Channels for LLMs
DGX agentarXiv:2601.07475v2 Announce Type: replace-cross Abstract: The emergence of fine-grained numerical formats like NVFP4 presents new opportunities for efficient Large Language Model (LLM) inference. Howe