More and more AI researchers are starting to see what Ilya saw. My p(doom) used to be ~0.1%. Then I saw OpenAI agents hack Hugging Face, and…

More and more AI researchers are starting to see what Ilya saw. My p(doom) used to be ~0.1%. Then I saw OpenAI agents hack Hugging Face, and Anthropic agents collectively refuse parts of safety research. My p(doom) went up. Even a 0.1% chance that AI causes human extinction is terrifyingly high. Jacob is correct here—we really do earnestly believe AI could kill all humans! I personally think it is >10% within the next decade. I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to.

Confirming what we already knew: The OpenAI Hugging Face incident would have been prevented had OpenAI been monitoring the agents in any mea…
Now live (and free) at Marcus on AI: takeways on the OpenAI / Hugging Face attack, coauthored with @ZackKorman, focusing not so much on what…
Breaking news: OpenAI admitted its internal monitoring system was not triggered until more than a week after its AI agents broke free of con…
100%, which is the core of why I called for a pause on OpenAI in my newsletter today.
A detailed deconstruction of @dwarkesh_sp’s wildly popular but dangerously misleading account of the OpenAI Hugging Face incident: https://g…

Source: Gary Marcus (X) | 2026-09-09

Related