When Entropy Is Not Enough: Reclaiming Lost Semantics in LLM Output Length Prediction
DGX agentarXiv:2608.15592v1 Announce Type: new Abstract: Efficient LLM serving is often bottlenecked by the need to pad sequences to a fixed maximum length, and this wastes compute and degrades throughput. Pre