AOSpec: Action and Observation Co-Speculation for Low-Latency Agent Serving
DGX agentarXiv:2608.00881v1 Announce Type: new Abstract: Large language model agents increasingly act through stateful tools, yet model generation and environment execution remain serialized at every step. As