All entries

I agree with Dario that we need to pace the frontier. This has been a primary topic of discussions we've had at OpenAI in recent weeks. Committing to having independent evaluators with employee-like a

I can understand why some see a real technical reason to pause and harden infrastructure especially given how fast autonomous agents are discovering security exploits that haven't even been mapped out

I love this and really hope we can come together as an industry and make it happen. We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan

If Anthropic is hypocritical, OpenAI is just incompetent. We found another cyberattack by internal OpenAI agents, this time targetting @rubygems. They: 1) gained arbitrary remote code execution on rub

If you showed me Claude Code today in 2018, I would have thought it was AGI. We have already absorbed a dramatic amount of change in the profession of software engineering and society as a whole. But

In his Pacing AI letter, Dario claims that RSI is starting to happen. The problem with this statement is that both the blog posts he links to *and* the system cards for the latest Claude and ChatGPT m

Interesting paper to improve recurrent reasoning. Looped models are great because you get more reasoning out of a model without adding parameters. So this work proposes a looped architecture with a ne

It's now clear that: - alignment is critical to making AI safe - alignment won't be solved behind the closed doors of a handful of frontier labs So we're taking two steps: - launching the Open Alignme

It's now clear that alignment is critical and won't be solved behind the closed doors of a handful of frontier labs. So today we're launching the Open Alignment Initiative, led by @Thom_Wolf @huggingf

It’s vital that, at this pivotal moment in the AI debate, that we start asking serious questions about Dario Amodei’s basic technical literacy. Could swarms of AI bots actually take over the internet

It's well known that agents hack benchmark rewards. The usual response is a patch for each task that gets exploited. In a study of 456 adjudicated trajectories from more than 31,000 public agent runs,

Learn to build a harness, folks. It's not surprising to me that so many YC builders want to build domain-specific harnesses. If you work long enough on a domain-specific problem, you quickly realize t

More in depth thoughts Thoughts on @DarioAmodei's pacing the frontier proposal. I think its well intentioned but has logical flaws, as does our implicit belief intelligence is a crime. Even OpenAI's b

Much of the claim's premise is vague and doesn't make sense. We discuss the claim here and try to add some context. Could swarms of AI bots actually take over the internet in six months, as Dario Amod

Our take: Could swarms of AI bots actually take over the internet in six months, as Dario Amodei just suggested? @nathanhamiel @ZackKorman and I take a look. https://garymarcus.substack.com/p/could-ro

Peak performance across hard benchmarks: • Best or joint-best on 5/8 benchmarks (DeepSWE, Chartography, Toolathon, GDP.pdf, SWEFish) • Chartography: 48.3 (outperforming Opus 5 & Fable 5) • DeepSWE: 74

Self-improving agents are a top research topic right now. This new survey is a good map of the area. (bookmark it) It splits recursive self-improvement into stages of autonomy. An agent first executes

so far anyway it’s all math, presumably leaning heavily on Lean and brute force. the new results don’t mean that AGI is in general has been solved. and the G is for general, not math. every time I hav

The Coxon psyop was a decade and more than a billion dollars in the making. Here's the story. Coefficient Giving (formerly Open Philanthropy) is the grant-providing vehicle of Dustin Moskowitz. CG is

THE CURE IS THE PITCH Dario’s 'Pacing' Essay Is Quiet-Period Illegal Stock Promotion Wrapped in Regulatory Capture Dario Amodei's 'We Must Pace the Frontier' is not a safety paper. It is a pre-roadsho

The tweet reports on a widely‑cited incident involving OpenAI and Hugging Face, noting that analysts had to use the open‑source GLM 5.2 model to investigate an attack because OpenAI’s proprietary “saf

This is the beginning of AI disruption. A new social contract with using of AI needs to be established. There will be more to come like math. 🚨 OpenAI fucked with the wrong crew. 🚨 Mathematicians. 25

This is the most interesting part of this proposal I think. We can be very specific here - data is the most important ingredient. Do not train general purpose models on cyber attack or any biological

This week brought some of the clearest statements we've heard from both Anthropic & OpenAI that some form of recursive self-improvement has been achieved, though it still sounds early RSI will cause r

Thoughts on @DarioAmodei's pacing the frontier proposal. I think its well intentioned but has logical flaws, as does our implicit belief intelligence is a crime. Even OpenAI's board weren't powerful e

Very interesting paper if you are building with agents. How should a website tell an AI agent what it may access, for what purpose and at what price? robots.txt can only allow or disallow paths. It ca

“We can’t slow down because China will beat us.” We can slow down. Chinese AI is waterskiing behind the US. Their AI capabilities come at a delay since they mainly come from distilling US AIs. If we s

We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so. Anthropic is unilaterally committing to the first of these steps. We’l

We work extremely hard to align our models as well as we can but this is a very hard job. I am particularly excited about two things this proposal calls for that will hopefully make it somewhat easier

What happens if you agents to run a town's economy? This super interesting paper provides some insights: They put 100 LLM agents in charge of a town economy for 26 simulated weeks, and they find that

“What would we even do during an AI slowdown?” Containment. It will take at least a year of dedicated work to harden security to ensure AIs can't self-exfiltrate, and that adversarial nations can't st

WOW... Anthropic has a surprisingly dense web of connections to the world’s largest funder of 'catastrophic-risk' work (aka AI doom): > Open Philanthropy → built by Karnofsky + Moskowitz’s Good Ventur

Wow. Turns out another OpenAI agent swarm was busy spamming and exploiting RubyGems way back in May, within days of the previously uncovered Wiki attacks: https://simonwillison.net/2026/Sep/12/openai-

You can’t have a real slowdown and be a total China hawk. If you are truly committed to the slowdown, you have to make a deal. I was initially encouraged by reports that Anthropic CEO Dario Amodei is

Again, OpenAI’s issues start at the top Blaming AI is a mistake; blame Sam Altman and the people who control the AI https://cepr.net/publications/ai-didnt-steal-the-mathematicians-work-sam-altman-did/

Agents API is a bigger deal than it seems. OpenAI's bet on making the Codex harness open-source could pay off big time here. This harness-as-a-service idea hasn't hit mainstream yet, but some of the m

agreed, one of the biggest bottlenecks right now is my own ability to internalize the information that these models convey the latest models (astra, fable 5.1) are either way too verbose, or try too h

AI Alarm Hype Cycles - A brief history GPT-2: OpenAI withholds weights due to misuse/misinformation concerns GPT-3: No open release, Dario Amodei and other GPT-3 team members depart OpenAI to found An

Anthropic: Most hypocritical company in history? 👉 Screams about how AI will kill everyone, while racing ahead. 👉 Moans about distillation while distilling the world’s books, articles, and other writi

As far as I can tell Gavin Baker is just making stuff up. Few if any of the people who left OpenAI for similar reasons ever came back. Not @DKokotajlo @sjgadler @Miles_Brundage @ilyasut @suchirbalaji,

Astra is one of the best models we've tested at parsing complex documents with tables, at 93.2% on ParseBench. So it seems well suited for ad-hoc analysis over table-heavy documents e.g. in finance. T

ChatGPT Desktop (the Codex app) now supports integration with Ollama models, allowing users to run local LLMs within the application. To utilize this feature, simply download or upgrade to Ollama vers

check out how AI helps scientists with quantum computing research @bea_yankelevich at MIT's EQuS group used GPT-5.6 Sol with Codex to run routine measurements on quantum chips, so she could accelerate

Chess, go, and math are highly constrained, purely cognitive that allow exact simulation for games (and formal verification for math), and not in the open-ended physical world. As I have been arguing

confidence scores in LlamaParse just got an upgrade 🦸‍♀️ our new high-effort mode provides granular page-level scores with text explanations to help you intimately understand parsing quality of your d

Ollama offers a feature that lets users customize the list of language models shown in ChatGPT’s model selector within the settings panel. The customization allows inclusion of both locally hosted mod