Prediction-Assisted Pricing and Admission for LLM APIs with Stochastic Token Consumption
DGX agentarXiv:2609.00710v1 Announce Type: cross Abstract: An LLM application often sells or internally allocates several service products: a small or premium model, a short or long token cap, and possibly mul