The Hidden Cost of Structured Generation in LLMs: Draft-Conditioned Constrained Decoding
DGX agentarXiv:2603.03305v2 Announce Type: replace-cross Abstract: Large language models (LLMs) are increasingly used to generate executable outputs, JSON objects, and API calls, where a single syntax error ca