Search: “inference”

GPT-6 Sol from @OpenAI on ARC-AGI (Verified): - ARC-AGI-3: 4.6%, 5.6K (standard harness), 23.0%, 8.7K (provider adapter harness) - ARC-AGI-2: 89.6%, 0.44/task - ARC-AGI-1: 95.5%, 0.14/task Sol reaches

OpenAI's New Agent Stack: Superhuman Computer Use, Dots, Decisions API, UltraFast, & the AI Cloud https://www.latent.space/p/devday-2026 @OpenAI’s @AriX and @nikunjhanda explain why Computer Use is al

During a Swyx podcast interview in October 2026, an OpenAI engineer revealed that the company’s Decision API is built on the GPT‑6 Luna model, augmented with a dedicated decision head. This configurat

Sharing some notes from OpenAI DevDay in parts. The first part matters, since it's on everyone's mind. How do you optimize for cost and performance? If you are building agentic applications today, the

💯💯💯: “If AI is going to produce trustworthy and genuinely novel insights in science, medicine and beyond, we need systems whose conclusions arise from an auditable process of evidence, inference and b

A new breed of startups is emerging to help businesses use AI smarter and cheaper, shifting towards open Chinese models and giving the likes of OpenAI and Anthropic a run for their billions. Read more

On October 7, 2026 OpenAI released a session titled “Explore ideas through interactive visuals that respond as you learn, try, and discover.” The webcast showcased real‑time visual tools that adapt to

The cancelation of the Grace Hopper Conference may actually point to a reduction in overall junior-level recruitment and job growth. I spoke about AI at GHC 2018, and it was 20,000+ attendees, majorit

Impressive new work from Google DeepMind showing real-world applications of agents for scientific research. Impressive new paper from Google DeepMind. (bookmark it) It takes Co-Scientist out of simula

Great paper from Google and colleagues. It proposes an interesting approach to improve agents on long-horizon tasks. Long-running agents slow down and start poisoning their own context. Both symptoms

Banger paper from Google DeepMind and colleagues. (bookmark it) A model reads its entire KV cache on every generated token, even though it ends up attending to a tiny slice of it. In other words, if y

Pay attention to this new wave of System One models if you are building custom harnesses. First Jev. Now, Contrastive Language Model (CLM). CLM is 9x faster than Jev. CLM seems to be a better verifier

Personal agents gone wrong. As we embrace more personal agents to carry out personalized tasks in the real world, interesting dynamics and behaviors will emerge. I think personal agents as they stand

I just made the most expressive real-time motion harness for the Reachy Mini. It was created by: > synthesizing a massive motion dataset using Astra (over 10000 samples) > fine-tuning Qwen 3.5 4B usin

AI is driving the biggest infrastructure build-out in history, with @Google alone forecasting $200B of capex in 2026E. What are the real constraints on a system at this scale? Amin Vahdat is the chief

David Silver is one of the all-time greats. He was the creator of AlphaGo, which changed the course of history by showing that neural nets could achieve superhuman performance for the first time. He a

Great paper on designing multi-agent systems. How many distinct communication topologies does an LLM multi-agent system actually need? This works claims that it's about six. Technical summary: Researc

// human-values.pseudo | ARTIFACT 0.1.0-experimental.1 | BASE 1.2.0-rc1 | EDITION ai-compact | NARRATOR System_Synthesis_Node_01 | PROVENANCE human-directed, AI-assisted | STATUS single-encoder resear

don't get distracted by all the hedging words in its name ('flash', minor version): seems like DeepSeek V4.1 Flash is a major update weights at: https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash

Live now: our Inference Engineering Track from AI Engineer World's Fair 2026. A benchmark tool told to run 200 queries a second that ran 38 and reported 200. A model that answered one prompt in a thou

Decision models in llama.cpp are now available The `/v1/systemone` endpoint is available in the latest llama builds. Use it to do Jev-style inference locally, efficiently and privately. Multiple open

decision models + local ai = ❤️ tried Laya (421M) on llama.cpp in a little apple-picking benchmark, it's almost as good as Qwen 4B at 12x the speed. Media Decision models in llama.cpp are now availabl

llama.cpp can distribute inference on heterogeneous devices through the ggml RPC backend It's an advanced setting but I think with time we'll make it more accessible to regular users. It's crazy that

The cancelation of the Grace Hopper Conference may actually point to a reduction in overall junior-level recruitment and job growth. I spoke about AI at GHC 2018, and it was 20,000+ attendees, majorit

We are in an insane run of open-weight drops. Every modality, open source is winning. This is what an open source AI summer ☀️ looks like: 🧠 LLMs & Reasoning → DeepSeek-V4-Flash-0731 (my king 👑): 304B

My cofounder Tim, whom you will not find on X, shares some of the strategic thinking behind our latest updates https://venturebeat.com/infrastructure/mistral-ai-wants-to-build-1-gigawatt-of-european-c

Today, we’re announcing a strategic collaboration with @HUMAIN spanning AI infrastructure, advanced model development, and the deployment of AI solutions in Saudi Arabia and across the region. Togethe

We have just raised 3B€ to accelerate our R&D. We are scaling up our training and inference compute to build future generations of our models, and expanding our Science team across all our offices --

Our open-weight models, products and infrastructure give organisations a real choice over how and where they run AI, not just access to a model. That's frontier performance without the lock-in. Full s

Mistral AI announced on 16 September 2026 that it has partnered with Mozilla to embed privacy, control, and choice features for users interacting with artificial‑intelligence–powered browsing tools. T

Malware reverse-engineering: solving an out-of-distribution investigation task. When faced with an unknown binary, Mistral Large 4 reverse-engineers it end-to-end. In this case, it concludes the sampl

Mistral AI outlines its vision for engineering, manufacturing, and earth observation by demonstrating how the model can inspect mechanical components, extract evidence from PDFs, and analyze gigapixel

lol so it’s possible that OpenAI’s guardrails prevented huggingface from being able to analyze the logs of attacks from… OpenAI’s model. so they had to switch to an open source Chinese model 😵‍💫 @Open

Elon’s original vision of an open, American AI was right. He could still flip Grok to open source which could be checkmate. Why? If you flip Grok open source, you necessarily move all margins out of t

anyone confused about neurosymbolic AI—and its recent enormous victory—should read this. complete and total vindication for what I have been saying here all along. (see also my essays on Claude Code a

More data than open-source AI is taking share from OpenAI and Anthropic. Open source has gone from 28% token share to 62% token share @vercel over the last 2 months. Chart from @rauchg Super impressiv

BREAKING: SpaceXAI has released a major new update for Grok Build (v1.0.13). The update improves reliability with automatic retries and recovery from truncated responses, inference failures, oversized

⚠️ The most important question hardly anyone is asking is whether Jensen meant 100K+ GPUs, or 100k+ NVLink72 server racks (which contain 72 Blackwell GPUs). ⚠️ From his wording, it sure looks like the

We're excited to announce our AI Engineer New York speaker lineup! Presented by @arizeai CEO @ExaAILabs CTO @tryramp CEO @ValsAI CEO @RogoAI CTO @modal CEO @trybasis CEO @SonarSource CEO @runwayml CTO

Grok @Bot works well on your phone. Just download the app from Apple or Android. https://apps.apple.com/app/id6794501026 This feels unreal Used Grok Bot today, mostly from my phone I got more done fro

Meet Wally. Our inference stack for open frontier models, built to be the fastest place to run them. Performance snapshot: GLM-5.3 Flash: 380 tok/s. GLM-5.3 Max: 790 tok/s Qwen3.8-27B: 485 tok/s DeepS

Must-read papers of the week ▪️ JEPA-Anything ▪️ Modality-Autoregressive World-Action Models ▪️ In-Context Robot Learning with VLM Agents ▪️ Dream-RSI: Recursive Self-Improvement through Evolving Worl

Together is #1 on @OpenRouter token share across top open coding models, today: 🥇 @Zai_org GLM 5.3 Flash: 29.2% 🥇 @deepseek_ai V4.1 Flash: 25.6% 🥇 @Kimi_Moonshot Kimi K3: 18.9% Running coding agents o

Reasoning from scratch, round number 6! An introduction (and implementation) of Reinforcement Learning with Verifiable Rewards (RLVR) and Group Relative Policy Optimization (GRPO). 00:00 Introduction

A tweet by Kristof (@CoastalFuturist) titled “How it feels to ask the Chinese ai models for help on something Claude won’t agree to” was posted at 1:30 AM on Oct 4, 2026. The post garnered 616.3 k vie

DeepSeek V4.1 Flash is now available for training on both the Dedicated Training API and Managed Training surfaces! It's a strong base for agentic coding, terminal automation, and tool use. It's also

Bullish on this trend of making post-training more accessible. A new post-training era is upon us. If you work on agentic RL, long-context tasks (a big focus today) are expensive, inefficient, and don

Impressive by @river_ai_inc to beat @deepseek_ai rates - cache in particular is tough! Talented team there, full RL + inference stack should be real competition River Inference is live! We're serving

So I would like to share my analysis of PD disagg that I've run by Horace and many folks at Thinky You may have heard that PD disagg helps with per-token 'tail latencies' in ITL/TPOT, as prefill inter

Cognition is the first customer running @NVIDIA Vera Rubin, powered by @CoreWeave! Hopper in 2022. Blackwell in 2024. Now Vera Rubin: On SWE-2 inference, the new chips deliver about 4.8x more token th

Banger paper from NVIDIA on long running agents. A model can accept 128K tokens of context and still make more mistakes the longer it works through a task. If your agent loses its place partway throug

'It's well worth spending the money on tokens if the business is getting the benefit.' — IBM Cloud GM Alan Peacock We're scaling open-source inference with @IBM + @nvidia on a dedicated B300 cluster o

Together AI announced that it is expanding its enterprise‑grade inference capabilities by partnering with IBM Cloud and NVIDIA. The move leverages IBM’s cloud platform for scalable compute resources w

yesterday we took SF @Techweek_ to the water ✈️ The Science of Speed brought together founders, researchers, and builders front row for Fleet Week with @nvidia and @dtcp_capital. not to mention a gues

The cancelation of the Grace Hopper Conference may actually point to a reduction in overall junior-level recruitment and job growth. I spoke about AI at GHC 2018, and it was 20,000+ attendees, majorit

Congrats to @lightseekorg on the impressive TokenSpeed results! 🚀 Great to see Qwen3.8-Flash-Next reaching 685 output tokens/s per user on Nvida GPUs. Excited to see the community unlock more of Qwen’