Model Releases
Perceived Error is one of the clearest signals that your agent is giving users a great experience. We tuned the model and prompt around sign…
Perceived Error is one of the clearest signals that your agent is giving users a great experience. We tuned the model and prompt around signals that tend to carry across domains, like a user correctin
Perceived Error is one of the clearest signals that your agent is giving users a great experience. We tuned the model and prompt around signals that tend to carry across domains, like a user correcting or rejecting an answer, repeating a request because something was missed, or leaving the conversation with an unresolved problem. Because these signals describe how the interaction unfolded rather than whether a domain-specific answer is objectively correct, we think Perceived Error maps really well across many types of conversational agents. Give it a try! Introducing LangSmith Tuned Evaluators They automatically score agent behavior in production, starting with Perceived Error. Perceived Error is one of the clearest signals that your agent is giving users a helpful experience. In our benchmark, our specialized model outperformed e…
Related
- LangSmith’s new Tuned Evaluators look pretty interesting. Perceived Error can flag agent mistakes in production by picking up on user correc…
- New Tuned Evaluators from @LangChain Versioned judges you just 'turn on' in a tracing project The 'Perceived Error' Judge flags conversation…
- 🚀Today we launched LangSmith Tuned Evaluators, starting with Perceived Error. Tuned Evaluators run on production traces to catch undesirabl…
Source: Harrison Chase (X) | 2026-08-18