Calibrated Speculative Decoding: Frequency-Guided Candidate Selection for Efficient Inference
DGX agentarXiv:2604.13634v1 Announce Type: new Abstract: Speculative decoding accelerates autoregressive generation by letting draft tokens bypass full verification, but conventional frameworks suffer from fre