BitNest: Bit-Nested Speculative Decoding for Memory-Efficient LLM Inference Acceleration
DGX agentarXiv:2610.02800v1 Announce Type: new Abstract: Speculative decoding accelerates autoregressive generation by using a lightweight draft to propose multiple tokens for parallel verification. However, e