MineDraft: A Framework for Batch Parallel Speculative Decoding
DGX agentarXiv:2603.18016v2 Announce Type: replace-cross Abstract: Speculative decoding (SD) accelerates large language model inference by using a smaller draft model to propose draft tokens that are subsequen