DIVERSED: Relaxed Speculative Decoding via Dynamic Ensemble Verification
DGX agentarXiv:2604.07622v1 Announce Type: new Abstract: Speculative decoding is an effective technique for accelerating large language model inference by drafting multiple tokens in parallel. In practice, its