Agents
'jev as a judge' cheap and fast semantic verifiers! great for evals - especially online evals where you want to grade LOTS of traces
'jev as a judge' cheap and fast semantic verifiers! great for evals - especially online evals where you want to grade LOTS of traces We tested Jev against LLM judges on accuracy, repeatability, latenc
"jev as a judge" cheap and fast semantic verifiers! great for evals - especially online evals where you want to grade LOTS of traces We tested Jev against LLM judges on accuracy, repeatability, latency, and cost to see whether System One models could offer a new approach to agent evaluation. https://x.com/i/article/2101448785255907328
Related
- We tested Jev against LLM judges on accuracy, repeatability, latency, and cost to see whether System One models could offer a new approach t…
- jev as a Judge proves to be a cheaper and more precise alternative to LLM as a judge for online evals. great guide from Sean and Daniel on w…
- Verifiers are important for scaling evals/RL But costs add up! So can we make them cheaper? Some great work by @Vtrivedy10 @jakebroekhuizen …
Source: Harrison Chase (X) | 2026-09-20