Information-Theoretic Foundations of Online Temperature Sampling
DGX agentarXiv:2610.15043v1 Announce Type: new Abstract: Repetitive, degenerate generation is a persistent failure of LLM decoding, and the standard remedies (temperature, nucleus, and top-k sampling) are stat