Search: “harrison-chase--x”

Agents have become way more capable in the last few months. What hasn't caught up yet is the applications and interfaces around those agents! (if you say TUIs are the end state for agents, please seek

Do agents listen to you… or themselves? While evaling subagent behavior in deep agent systems, we noticed an interesting quirk in our agents' alignment with hand-written system prompts vs. the instruc

i feel like there's a general misunderstanding about open source models. most people use a frontier model, switch the api request to open source model, see poor performance, and then churn off. this w

The sandbox Auth Proxy is a security mechanism designed to control and limit the interactions between AI agents and external systems by establishing a controlled boundary. This explainer from Harrison

Managed Deep Agents is a new LangChain feature in private beta that provides managed infrastructure for deep agents, designed to be model-agnostic and deployable with minimal code. The service aims to

On Evals - getting messages on “ok so how do I actually start learning this?” there is no better way than by just doing so you can copy this to Claude Code and get started today <instructions> 1. Go l

This tweet by Hunt Lovell, shared by Harrison Chase, addresses questions about interpreters in the context of AI agent evaluation. It suggests that the effectiveness of interpreters should be validate

streaming from modern agents is pretty complex! especially with - parallel tools / subagents - multimodal content - human in the loop events our new streaming primitives make all of this ergonomic! Ag

This post likely discusses early-stage security features or improvements for AI agents, possibly from LangChain or a related AI framework that Harrison Chase is involved with. The 'alpha' designation

a few months back, it become clear to us that a large part of technical work would be driven by agents in the future. coding agents were becoming ubiquitous and highly capable. since we build a platfo

This post likely discusses strategies and techniques for improving AI agent design and capabilities, possibly including methods for training agents to be more effective at complex tasks. The content a

as agents run for longer and with more context, there's a lot of tricky things you have to consider for deployment! super excited to dive into deploying Deep Agents for this Boston tech week meetup! .

brain dump of how/why we use Evals to measure agents before & after shipping to prod 1. Good Evals simulate what our real users will do and encounter. They’re not really random benchmark tasks, they r

code interpreter is a light weight code execution environment lets you do: - RLMs - programmatic tool calling - more! without having to spin up a full sandbox we'll be writing a lot more about the use

deepagents v0.6 ships w/ support for code interpreters! these are the perfect happy medium between pure tool execution and heavyweight sandboxes they give your agent an environment where it can... → k

fun read on real tradeoffs & design decisions we debated when designing Engine for the data scale that customers produce one common thread is that we’re pretty strong supporters of just giving the age

Hunt Lovell from the LangChain open-source team provides an explanation of interpreters, likely covering how interpreters function within the LangChain framework for executing code or processing langu

ICYMI: LangSmith Sandboxes are GA ✅ Agents get a real filesystem, shell, and package manager. Isolated from your infra. ✅ Works with Deep Agents, Open SWE, or your own code. ✅ Auth with the same API k

no trace left unread, no issue left unfound 👀 With Engine we’re pointing agentic compute across every trace across every agent so every team can find product feedback, bugs, issues 24/7 langsmith engi

Personally incredibly exciting at LangChain Labs to lead a focused, applied research effort into Continual Learning. A big prior is in treating the long horizon agent optimization problem as one that

Stoked to work closely with @Vtrivedy10 on this. I've spoken about it before but an emerging trend i'm seeing with many of the ai-native companies I work with (shoutout @larsen_weigle_ ) is a focus on

the first step to building evals is often times figuring out what you want to eval (sounds simple, in practice it has a lot of nuance) you can condense long horizon evals with agents into smaller subs

Exa, a search lab focused on organizing web data for AI agents, announced a Series C funding round of 250 million at a 2.2 billion valuation, led by venture capital firm Andreessen Horowitz (a16z). Th

We’re hiring for Labs! 🧪 If you’re interested in working with us to push forward Continual Learning, pls DM me with a blurb + link to the best Applied Research you’ve done (or even better shipped!) yo

working on some hex dashboards -- this is a bummer! if you use langchain/deepagents as your agent harness, you can swap models with fallback middleware when your first choice provider is down https://

you can condense long horizon evals with agents into smaller subsets that still let you test intended behavior. i'm currently evaluating an agent that runs for 30+ minutes, and analyzes thousands of t

This post likely documents the technical architecture and development process behind Engine, a software component or platform, shared by Palash Shah. The content presumably covers key design decisions

Curious finding while creating evals and benchmarks for long-horizon (100+ turn) agents While it’s generally thought that a direct swap to open source models can bring immediate cost savings, that’s n

Deep Agents now integrates with @nebiusai Token Factory. Now, you can run agent workloads on production-grade AI infrastructure with open-source models, dedicated endpoints, real-time search, and full

deepagents v0.6 is about performance the first level at which we can control that is the model layer: how can you squeeze perf out of a model? tweaking prompts, tool names, and tool descriptions in ac

Engine is a sophisticated production agent system developed by a team that Harrison Chase recommends for understanding advanced agent architecture and implementation. The post suggests it represents n

Excited for this conversation with @hwchase17 , Co-Founder & CEO of @LangChain , on June 2 at the @traversal_ai office in NYC. We’ll be talking about what it actually takes to operate AI agents in pro

Harrison Chase provides a detailed technical overview of the architecture and development process behind LangSmith Engine, sharing key learnings and practical tips accumulated during its construction.

This post likely discusses techniques and methodologies for building AI agents capable of performing AI engineering tasks, such as code generation, model optimization, or system design. It probably co

I've been thinking a lot about the two different groups of evals you need in general agents/agents which handle broad tasks: 1. Benchmark evals - this is a suite of up to 100 eval cases which test the

LangSmith Engine is a tool within the LangChain ecosystem that provides visibility and debugging capabilities for AI applications built with LangChain. This technical deep-dive likely covers how the e

LangGraph.js Long-Term Memory Store is now generally available. This integration brings long-term memory across sessions, across users, and across time, with Atlas as the unified backend for checkpoin

Most teams building agents are tracing their agent and reviewing the outputs, but the flow from error identification to merged fix is manual and slow. Engine is built to close that gap. https://www.la

Read more on what we've learned while developing long-horizon agent evals: Curious finding while creating evals and benchmarks for long-horizon (100+ turn) agents While it’s generally thought that a d

this has probably been the most interesting project i've ever worked on. we created the best agent at finding problems with your agent. and we integrated it with the best observability platform to spi

This release is absolutely stacked. I want to call out a sleeper feature: Interpreters Imagine your cloud agent gets a 10k-row CSV of support tickets. Without a code runtime, the model is stuck reason

two years ago we started building agents to automate work. turns out these are really useful, so there’s a LOT of runs and long traces that are hard to reason about now, use an ambient agent (engine)

a lot of stuff to be excited about in this release! We're centering on two things to make deepagents great: - how do we make the most performant harness - how do we make it a joy to work with and buil

announcing deepagents v0.6, our biggest release yet! it’s all about performance: at the model layer w harness profiles, agent layer w code interpreter, and at scale w streaming and delta channels cont

Behind the scenes of SmithDB with @ankush_gola11 ⤵️ We leveraged two amazing open source projects when building SmithDB. One is @ApacheDataFusio: an extensible Rust based query engine. We built custom

ICYMI: SmithDB is our purpose-built data layer for agent observability + eval workloads. Supporting increasingly complex query patterns at low latency, over large traces, with self-hosting + multi-clo