Uncertainty-Aware Sequential Decision Rules for Event-Triggered LLM Invocation in Streaming Systems
DGX agentarXiv:2607.13048v1 Announce Type: cross Abstract: Streaming inference pipelines increasingly pair lightweight fast models with Large Language Models (LLMs) that provide rich semantic understanding at