Agents
😂 you might call this ... slippery slop
😂 you might call this ... slippery slop if you’re building an ai app, you might want to host inference to improve your margins, and if you do that you should support a few models, and if you’re doing
😂 you might call this ... slippery slop if you’re building an ai app, you might want to host inference to improve your margins, and if you do that you should support a few models, and if you’re doing that you might as well build a router, and then ppl want to evaluate so you build tracing… and that’s how everyone ends …
Related
- if you’re building an ai app, you might want to host inference to improve your margins, and if you do that you should support a few models, …
- LLMs are stateless (every time you reply to an LLM, you re-inject the entire conversation to a fresh inference) the purpose of memory is to …
- We turned the browser into the inference server. @RunAnywhereAI ( @runanywhere/web ) runs models client-side with WebGPU + WASM SIMD, stores…
Source: Yohei Nakajima (X) | 2026-10-04