SpecQuant: Speculative Decoding with Multi-Parent Quantization for Adaptive LLM Inference
DGX agentarXiv:2609.21704v1 Announce Type: new Abstract: Running large language models (LLMs) locally continues to be limited by restrictions of compute and memory on consumer hardware. The popular acceleratio