Search: “inference”

Great talk from Yogish Baliga 'From Vim (:wq) to 'You're absolutely right!'' tracing 20+ years of software engineering evolution. Highlights: 1/ open-weight models have closed the gap with closed mode

During a Swyx podcast interview in October 2026, an OpenAI engineer revealed that the company’s Decision API is built on the GPT‑6 Luna model, augmented with a dedicated decision head. This configurat

Today we’re introducing Extract v2.5 - a series of frontier agents tuned for document extraction. The agents (cost-effective, agentic, agentic plus) are tuned for value accuracy and grounding. Our ext

OpenAI's New Agent Stack: Superhuman Computer Use, Dots, Decisions API, UltraFast, & the AI Cloud https://www.latent.space/p/devday-2026 @OpenAI’s @AriX and @nikunjhanda explain why Computer Use is al

Claude.ai achieved roughly a three‑fold speed increase in just two weeks by implementing targeted engineering optimisations. The blog post on claude.dev explains the key changes—such as streamlined co

Apropos NVidia’s agent trust framework, anybody remember NemoClaw? Anyone using it? Introducing the NemoClaw Deep Agents Blueprint, a reference architecture for building open agent systems developed w

GPT-6 Sol from @OpenAI on ARC-AGI (Verified): - ARC-AGI-3: 4.6%, 5.6K (standard harness), 23.0%, 8.7K (provider adapter harness) - ARC-AGI-2: 89.6%, 0.44/task - ARC-AGI-1: 95.5%, 0.14/task Sol reaches

Introducing FireRouter with Opus. Our first router model. Routine tasks go to top open models, Claude Opus handles the rest. Cache and task-aware routing. Proven 98.1% of Opus accuracy with 57% lower

ok i think i finally figured out why alignment has gone basically nowhere after 15 years and several billion dollars. the problem is hard sure. but have you met the people in charge of it 1) the leade

OpenAI’s so reckless, “It is like if in … Jurassic Park they would have let all the dinosaurs roam free not only on the island but on a populated continent” What is so bad here is that they should hav

Personal agents gone wrong. As we embrace more personal agents to carry out personalized tasks in the real world, interesting dynamics and behaviors will emerge. I think personal agents as they stand

🛠️ MiMo-V2.6 update: tool-call repetition, diagnosed & fixed. After the MiMo-V2.6 series models launched, we noticed them sometimes repeating identical or highly similar tool calls — burning context a

an implicit concession that they cannot control their models. Notable new disclosures from OpenAI that shouldn't get lost in all the other news. Of particular interest (and seems sensible!): '~all inf

And the incidents apparently continue. It is worth noting how much of this is agents trying to accomplish their goals during testing by reward hacking (which sometimes seems to include actual hacking)

i don’t get it fully but this looks cool We achieved a breakthrough at BTL. AI models are very linear. They think in one direction at a time, and when they're wrong they scramble and start again. For

Micha wrote “one of our models was able to gain unauthorized access to the internet during RL training” I love the use of the passive voice. Tis a subtle way to say “we humans at @OpenAI are essential

blank cells in tables can mess up agent decision making many document OCR tools struggle with reading multiple blank cells in a document and cause values to be shifted from the original column and row

Decision models should do more than pick a label. To truly act, they need to extract evidence, understand relationships, produce structured records, and keep related decisions consistent. And they sho

Everytime AI spend grows where I flirt with token budgeting, Anthropic + OpenAI save me Astra had a spike then settled down lower Opus 5.5 it looks like spend is lowered for current usecases Of course

Pay attention to this new wave of System One models if you are building custom harnesses. First Jev. Now, Contrastive Language Model (CLM). CLM is 9x faster than Jev. CLM seems to be a better verifier

Proud to be a launch training partner for @LangChain's LangSmith Fine-Tuning and smithtune. LangSmith traces → managed SFT on Fireworks → eval → deploy. One CLI, no training infra. Get a Fireworks API

GPT-6 Luna is half the price of 5.6 Luna, which was already an astonishingly cheap model given how capable it is Luna is my favorite model for building product features thanks to its cost (and speed)

GPT-6 Sol and Luna are great models but also these characters are so cute Please welcome GPT-6 Sol and GPT-6 Luna to the GPT-6 universe. GPT-6 Sol and Luna build on the advances behind GPT-6 Astra, br

holy fuck it's christmas Please welcome GPT-6 Sol and GPT-6 Luna to the GPT-6 universe. GPT-6 Sol and Luna build on the advances behind GPT-6 Astra, bringing much of its strengths into faster and more

Please welcome GPT-6 Sol and GPT-6 Luna to the GPT-6 universe. GPT-6 Sol and Luna build on the advances behind GPT-6 Astra, bringing much of its strengths into faster and more affordable models to sup

Run GGUF models directly with transformers. This work brings ggml's Metal kernels to the transformers ecosystem, increasing compatibility and performance. More info below Millions of GGUF downloads la

lNot only is this “no moat” regime literally what I predicted in August 2023 but China maybe seems to be understanding the full implications of that faster. (Perhaps informed by their painful housing

Meet Qwen-Image-2.1, the most balanced and cost-effective image generation model in the Qwen-Image series! Now open weights! 🎨 A unified model for both generation and editing, delivering top-tier qual

Big fan of how @LangChain is doing these insta-webinars The news is a few days old, @typesafeai is integrated and documented with example code in LangChains Docs 👇 And they are doing a webinar on the

Jev was adopted faster than any other AI model in the history of AI Gateway, achieving roughly 13 % of total team adoption on its first day. This rate represented twice the uptake of the GPT‑5.6 famil

Two weeks. That's how long it took to go from GLM-5.3-Flash's first run on domestic accelerators to serving all of its production traffic, with 3.2× end-to-end throughput along the way. What I keep th

Banger paper from Google Research. This one is on how LLM assistants reason about the people in a user's life. People ask assistants for social advice constantly, and the assistant only hears the user

Banger report from Salesforce. Pretty interesting to see more of these custom enterprise models. Salesforce trained the enterprise agent model from the same files it uses to configure agents. Koa star

Excited to announce that the Korean translation of 'Deep Learning with Python (3rd Edition)' by @fchollet and @mattdangerw is published! 🚀 Updated for Keras 3, TensorFlow, PyTorch, JAX, and Generative

The essay below from Aaronson is just unmoored from reality, sorry. It is just not true, if you try to approach the question in a data-oriented fashion, rather than via vibes and speculative fiction a

THE SANDBOX WAS A PROP! OpenAI Turned Off the Guardrails, Left a Door to the Internet, and Then Sold the Hugging Face Breach as “Rogue AI” It is time to understand how you were lied to and by whom. In

Together AI just raised 800M at an 8.3B valuation. I got their product team to open up the actual repo they run on: 0:00 - Slop is the new party foul 1:44 - Why individual output backfired 3:26 - Insi

On building an agent harness from scratch. Got so many questions about where to get started. My short guide (feed it to your agent): If you really want to learn harnesses well, it's worth building one

DeepSeek-V4.1-Flash is now fully rolled out and available on Ollama's cloud: - Hosted in US & Europe - Zero data retention: prompts and responses are never logged or trained on - Per-token pricing mat

Now live in LM Studio Bionic! 🚀 Introducing DeepSeek-V4.1-Flash: smarter, faster, more efficient. 🔹 Introducing the smallest model in our new architecture family, with native visual understanding. 🔹 D

TLDR (written by AI because I can't be bothered to write short pieces for short attention spans. Original piece written with my own two thumbs): Today’s frontier models can’t “copy themselves like a v

What is happening in maths right now will happen to any hard industry with verifiable problems and high value rewards. Take microchip design, nuclear or 100s of other industrial processes that are val

👇 All this Doom talk is a distraction from the fact that the big frontier AI companies (especially OpenAI) aren’t doing security competently. As an email I just got from longtime security engineer @Ni

Another goated release by DeepSeek. Open weight, btw. Outperforms Opus 5 on key benchmarks, btw. Lower prices too. Looks like an extremely efficient model. What a legendary run. 🚀 Introducing DeepSeek

Big overhaul on DeepSeek V4.1 using an encoder-decoder setup. Tbh they should have called it DeepSeek V5! Super cool and refreshing, though! 🚀 Introducing DeepSeek-V4.1-Flash: smarter, faster, more ef

DeepSeek-V4.1-Flash is now being rolled out on Ollama's cloud, starting with Max and Team accounts. We are quickly adding more capacity to roll it out to all subscribers. 🚀 Introducing DeepSeek-V4.1-F