Agents
if you’re building an ai app, you might want to host inference to improve your margins, and if you do that you should support a few models, …
if you’re building an ai app, you might want to host inference to improve your margins, and if you do that you should support a few models, and if you’re doing that you might as well build a router, a
if you’re building an ai app, you might want to host inference to improve your margins, and if you do that you should support a few models, and if you’re doing that you might as well build a router, and then ppl want to evaluate so you build tracing… and that’s how everyone ends up building the same thing
Related
- We turned the browser into the inference server. @RunAnywhereAI ( @runanywhere/web ) runs models client-side with WebGPU + WASM SIMD, stores…
- developers talk about agent harnesses/orchestration like it's back-end architecture and that if they could only get it right, they can keep …
- I think you should build your own harness too. Build on primitives. Models come and go.
Source: Yohei Nakajima (X) | 2026-10-04