Pyramid MoA: A Probabilistic Framework for Cost-Optimized Anytime Inference
DGX agentarXiv:2602.19509v3 Announce Type: replace-cross Abstract: We observe that LLM cascading and routing implicitly solves an anytime computation problem -- a class of algorithms, well-studied in classical