Recommended work from Meta on harnesses for proactive agents. The ProPerAgent harness raises accuracy from at most 15% with standard memory …

Recommended work from Meta on harnesses for proactive agents. The ProPerAgent harness raises accuracy from at most 15% with standard memory baselines to 38%, without changing the model's weights. But this success requires both a useful response and correct timing. The harness controls how personal memories reach the model as it observes the user's surroundings. First, the model identifies objects in view. A retrieval module uses those objects to search a graph of past experiences, preferences, and constraints. A separate LLM call then checks whether the retrieved memories justify offering help now. It filters out distracting or already resolved information and returns one concise piece of evidence, or nothing. The model uses that evidence and the current view to decide whether to speak or stay silent. That filtering step matters. Removing it drops accuracy from 37.3% to 24.0% in an ablation. Across the full harness, unnecessary interventions on clips that require silence fall to 15.3%, compared with 77.3% or 84.0% for standard RAG in the two evaluation modes. The harness also reaches 37.5% with Qwen3.8-27B without training. Additional RL training on that model raises accuracy to 42.4% by penalizing premature and repeated interventions. For proactive assistants, the harness needs to check whether a memory warrants an interruption before passing it to the model. Paper: https://arxiv.org/abs/2610.22671 Chat with Paper: https://academy.dair.ai/papers/properagent-toward-memory-driven-proactive-assistance-2610.22671

Source: DAIR.AI (X) | 2026-10-19

Related