Live now: our Inference Engineering Track from AI Engineer World's Fair 2026. A benchmark tool told to run 200 queries a second that ran 38 …

Live now: our Inference Engineering Track from AI Engineer World's Fair 2026. A benchmark tool told to run 200 queries a second that ran 38 and reported 200. A model that answered one prompt in a thousand with confident gibberish. A paper that dented memory chip stocks for a minute. https://www.youtube.com/watch?v=7c9FSUVcXR0&list=PLcfpQ4tk2k0W3_JZkL2SRVKTVOj7DoWtZ - Operating Distributed Inference Systems at Scale: Nishant Gupta & Naman Ahuja, Meta - Routing LLM Inference in Production: From Engine Signals to Policy: Qianru Lao & Lu Zhang, OpenAI - Are LLM Performance Benchmarks Reliable?: Ashok Chandrasekar & Jason Kramberger, Google - Vertical Mobility: Inference from MVP to Trillion-Parameter Workloads: Sitanshu Gupta, CoreWeave - What's New in Inference Engineering: @philip_kiely, Baseten - Large clusters for small models: @svonava, Superlinked - The Frontier AI Inference Cloud for Agents: Byung-Gon (Gon) Chun, FriendliAI - KV Cache-Aware Routing and P/D Disaggregation on Kubernetes: Yuchen Fama & Ashish Kamra, Red Hat - Two Bugs That Hid in Plain Sight: A vLLM Debugging Detective Story: Asaf Gardin & @yuvalinthedeep, AI21 - Weight Folding, CUDA Streams, and the Bug That Made My Model Speak Backwards: @f_makraduli, Superlinked

Related

• Today on AI:AM: @swyx, who coined 'AI Engineer', is gearing up for his next @aidotengineer World's Fair next week We'll be talking about his…
• Live now: our Harness Engineering Track from AI Engineer World's Fair 2026. Ports, proofs, kill switches, and what is left of an agent when …
• Live now! our Generative Media Track from AI Engineer World's Fair 2026. Thesis: everything hard about generative media happens before and a…
• Live now: our AI Architects, AI Factories Track from AI Engineer World's Fair 2026. Thesis: the model is the easy part of the factory. https…

Source: Swyx (X) | 2026-09-19