The Optimal Decoder is Tilted Temperature
DGX agentarXiv:2610.15058v1 Announce Type: new Abstract: Larger sample budgets benefit from higher sampling temperatures in LLMs, but what temperature tuning optimizes and why it works remain poorly understood