Search: “gpt”

even within math, frontier models are far from being general intelligences. and we still need people to assess which of their output are trustworthy and which are not. All frontier AI models (includin

2/ a cost benchmark showed the same coding task running three to four times cheaper, depending purely on the harness wrapped around the model. Same intelligence, wildly different accuracy and cost, de

An internal version of Astra, @OpenAI’s next major model family, solved 10 major open problems in mathematics, quantum complexity, and theoretical computer science. We believe it will be a major step

Answer from OpenAI @emollick re ARC-AGI-3: human testers scored ~48% (ARC uploaded testers logs to HuggingFace some time ago, I believe). re GDPval: it’s close to saturated now, so we’re mostly lookin

Ethan Mollick highlights that large, currently under‑explored benchmarks (e.g., ARC‑AGI, GDPval, METR long horizons, ASI cyber tasks) are growing in complexity, yet they increasingly lack systematic h

BREAKING: Grok 4.5 (high) ranks #1 on the HighWalk benchmark, which tests how well AI agents update technical specifications from code changes. Grok delivered the best combination of quality and opera

Model + harness. We have barely begun to understand the best ways to do harness engineering. A huge amount of untapped potential even without models getting better (but models are getting better) Turn

The number of times I have had to tell Opus 5 and Fable 5 to talk to me like an excited teenager and not a computer science phd is high. Was going through a Google auth thing and got multiple paragrap

Who on earth came up with 5 hour limits? The day is 24 hours long. While do our limit times shift by an hour each day. Pls if you are going to have limits 4 or 6 hours. Hello people of Sol! I've reset

Code Arena now measures fullstack capabilities! View overall rankings across AI models on full-stack web development tasks: multi-step reasoning, tool use, and end-to-end app generation. - Kimi K3 (Ma

The Opus 5 system card itself is a fun PDF to parse. It's 193 pages and stacked with labeled and unlabeled charts 📊 LlamaParse does a surprisingly good job on agentic (1.25c per page) and agentic plus

A new model launch is not a product update ‼ It's one of three things, and you don't know which until you test it. Sometimes it's nothing: the model improved inside the same distribution, your harness

Announcing OpenWorker! An open-source agent that doesn't just chat with you, but delivers finished work -- like hand you a polished document, send a slack message, or update a calendar entry. Ask it t

Great paper on self-improving agent harnesses. (bookmark it) If you maintain a production agent harness, finding every file behind one behavior is often harder than writing the edit. Harness Handbook

LlamaParse can't solve a conjecture, but it can parse this as a PDF 🫡 Dinitz-Garg-Goemans conjecture is false. This graph theory problem was open for ~30 years. The graph below has fractional flow cos

“If AI models were actually that good you could just tell them to solve open problems, make no mistakes and they would” … Oh Dinitz-Garg-Goemans conjecture is false. This graph theory problem was open

New for enterprises: OpenAI Presence helps companies deploy trusted voice and chat agents across customer and internal workflows. AI agents can answer questions, use company systems, take approved act

We benchmarked Gemini 3.6 Flash and Gemini 3.5 Flash Lite on document understanding. We compared against their prior versions - Gemini 3.5 Flash and Gemini 3.1 Flash Lite. 1️⃣ Gemini 3.6 Flash has rou

Incredibly proud of the Sakana AI team. We have developed an orchestration model right here out of Japan that achieves state-of-the-art performance on real-world cybersecurity benchmarks! 🎌 Introducin

Huge launch from @tryramp. Different steps in an agent workflow can use different models. This can help reduce costs significantly without sacrificing performance. Model routing will become a core par

someone just told me about this take* on CUA this is one of those gell mann moments for me lol. i've been watching computer use since World of Bits (Shi, fan, karpathy, hernandez & liang 2017). we wer

The Blender MCP is now part of the Hermes Agent MCP Catalog! Easily activate and install the Blender MCP by running `hermes mcp install blender` and ask your agent to start using blender. Hermes will

hello! Hello. We have reached 8M active users across Codex and ChatGPT Work. We are once again resetting the usage limits for all. And we continue to not have the 5h rate limit as well, allowing every

Computer use in Codex got very good on PC. Asking it to do something on your computer and having the cursor move under the control of a ghost is one of the things that makes you viscerally realize how

Another big reason to use combination of frontier models. Chain-of-thought monitoring is treated as a reliable safety layer for agents. This DeepMind-affiliated study shows the layer can be argued out

playing with local AI models and doing some research and came across a fun extrapolation: 'consumer grade graphics cards will be running Fable-equivalent models by 2029' the argument: 1) been said tha

GROK 4.5 LEADS ON REAL PROFESSIONAL WORK BENCHMARK New data from Snorkel shows Grok 4.5 outperforming other frontier models on real-world professional tasks. On their GDPval+ benchmark (expert-created

How to get 100% consistent product ads from one seedance 2.0 generation all directed from one chat with the hashtag Comfy MCP. @hellorob didn't let the agent improvise a pipeline. He pointed it at his

check this out! you can get some amazing things done. codex is the core of our new work product and what makes it so good. codex is not going anywhere. Introducing ChatGPT Work, a new agent in ChatGPT

create a really interesting game called 'Don't Discuss Goblins' that should have some story elements but mostly be fun and fast moving - the goal is to avoid mentioning goblins, and this should be cha

I'm writing a newsletter on my favorite AI models and AI tools for every single use case. This guide is specifically written for business users and not engineers and will help you get the most out of

Just shared my favorite AI model and tool for every use case. Check out the list here: https://aiwithallie.beehiiv.com/p/the-best-ai-model-and-tool-for-every-use-case I'm writing a newsletter on my fa

The metrics discussion at OpenAI is a little confusing to me. I appreciate the clarification about bad benchmarks, but they spent a lot of money developing a very good benchmark of autonomous model ab

Grok 4.5 true usefulness is excellent We obtained early access to evaluate @SpaceXAI's newest Grok 4.5 model on GDPval+: real professional deliverables (from a variety of economic sectors and occupati

Guess what we added someone else to this webinar: @jeffreyhuber, ceo and cofounder of chroma What does a vector database think about the concept of “wikis”? Come find out! It’s turning into a party gp

Xiaomi now processes more AI tokens than OpenAI. On OpenRouter, Chinese models just crossed 45% of all token volume. Anthropic is at 15.3%. OpenAI is at 7.4%. For now, the frontier is American models,

One of our creative technologists @hellorob just ran a full production pipeline without touching a single node - using Comfy MCP + Claude Fable 5. Production pipeline: → Shot pulled from web → scene d

Claude Fable running ComfyUI workflows through the Comfy MCP is a cheat code. → Claude pulled the shot from the web, auto-detected the scene cuts + trimmed it → ran my saved depthanything v3 + openpos

If that happens, where does it leave Anthropic and OpenAI? And Oracle, CoreWeave, Nebius, xAI, etc? Fable 5 probably running locally in about two years. That is the projection in this r/LocalLLaMA cha

Less than 2 years later, with Fable: 'simulate an encounter between a mind flayer and a drow warrior of equal CR. Set up initial stats then simulate each move, including initiative, rolling dice as ne

“This study cuts through the optimism surrounding medical AI by showing how easily benchmark success can be mistaken for real readiness. In medical AI, impressive scores are clearly not the same as tr

This is true… but maybe less important than the fact that people don’t try ambitious things with these systems. Many models are excellent as a Google replacement, for homework “help,” etc. It is someo

You really need your own benchmarks. If you are translating hieroglyphics, use Gemini 3.5 Flash. If you are running a vending machine use Opus 4.8. (This is one reason why I am skeptical of just swapp

Great paper on managing agent skills. Skill libraries keep growing, and picking the right skills has become a bottleneck for coding agents. The defaults are to expose the agent to the whole skill coll

My prediction: the excitement for Fable 5 will wear off really fast. Reposting this to help those who will be extremely disappointed after they play with Fable 5 and run out of tokens or can't do much

This is exactly why we believe in customization. Quick context: Factory's original secret scanner was deterministic, so it either flagged things that weren't actually secrets (false positives) or miss