Agents
5x faster than LLMs while being 13% cheaper than GPT 5.6 Luna, 88% cheaper than GPT 5.6 terra and 99% cheaper than Sonnet 4.6 is insane Has …
5x faster than LLMs while being 13% cheaper than GPT 5.6 Luna, 88% cheaper than GPT 5.6 terra and 99% cheaper than Sonnet 4.6 is insane Has anyone else used Jev for evals? We tested Jev against LLM ju
5x faster than LLMs while being 13% cheaper than GPT 5.6 Luna, 88% cheaper than GPT 5.6 terra and 99% cheaper than Sonnet 4.6 is insane Has anyone else used Jev for evals? We tested Jev against LLM judges on accuracy, repeatability, latency, and cost to see whether System One models could offer a new approach to agent evaluation. https://x.com/i/article/2101448785255907328
Related
- 'jev as a judge' cheap and fast semantic verifiers! great for evals - especially online evals where you want to grade LOTS of traces
- jev as a Judge proves to be a cheaper and more precise alternative to LLM as a judge for online evals. great guide from Sean and Daniel on w…
- We tested Jev against LLM judges on accuracy, repeatability, latency, and cost to see whether System One models could offer a new approach t…
Source: Harrison Chase (X) | 2026-09-20