Agents
Must-read paper integrating decision models like Jev into harnesses. They distilled an open 4B decision model, mostly from Jev's answers on …
Must-read paper integrating decision models like Jev into harnesses. They distilled an open 4B decision model, mostly from Jev's answers on the agent's own states, that beats Jev inside that agent and
Must-read paper integrating decision models like Jev into harnesses. They distilled an open 4B decision model, mostly from Jev's answers on the agent's own states, that beats Jev inside that agent and is much cheaper to run. Their harness, JevAgentHarness, sends each routine choice to the decision model and uses its answer only when the confidence clears a threshold fitted on the agent's own trajectories. Below the threshold, the LLM decides as usual. With the fitted threshold, tool and argument cascades cut cost by 14.2% without changing the outcome of any of 500 tasks. A fixed threshold of 0.5 lost 21.5 points. They also train AgentDecision-4B on states the agent reaches after its own mistakes, with Jev's answers as labels. On tasks unlike its training data, the agent solved 91.5% with it and 82.0% with Jev. On familiar tasks, 4B models trained this way made agents 81.1 to 89.0% cheaper and up to 2.5 times faster while staying within 3 points of success. Paper: https://academy.dair.ai/papers/jevagentharness-benchmarking-deploying-and-training-decision-models-that-share-c-2610.21412
Related
- Great new paper to read: Code as Agent Harness (bookmark it)
- I am bullish on simple agent harnesses. Love this idea from Vercel. fx is a new coding agent harness for model benchmarking, sandboxing, eva…
- NEW paper worth reading. A full agentic workflow can be distilled into model weights and run at roughly 100x lower inference cost while pres…
Source: DAIR.AI (X) | 2026-10-17