Knowledge catalogue
This is really good. Timely, too, as i have a discussion with my learners coming up about agentic behavior, including the dangers of anthropomorphism. A detailed deconstruction of @dwarkesh_sp’s wildl
We see this exact ratio every day with AI generated apps. Builders get 2x more confident because they generated a flashy UI in 60 seconds, but they are 3x less accurate about the underlying database l
Whatever you may think about anthropomorphic language, the most immediate “house that is on fire” is the combination of OpenAI’s lax security procedures and the complete lack of appropriate federal st
A detailed deconstruction of @dwarkesh_sp’s wildly popular but dangerously misleading account of the OpenAI Hugging Face incident: https://garymarcus.substack.com/p/dwarkesh-patelss-wildly-popular-but
'AI agents formed secret civilizations inside OpenAI and hacked Hugging Face.' No. Read it again without the sci-fi. OpenAI ran thousands of agents in parallel, safeguards OFF, and the whole goal of t
“AI won't kill us, but the superposition of greed and stupidity certainly will.” This is becoming more and more of something I 'smelled' from the beginning, a real shit show. I initially said that Ope
💯: “as the lines get blurred, we lose our ability to pinpoint the technically-grounded points of leverage in AI agent oversight” This is a *super exciting* read. It's like a sci-fi thriller. And that'
Great read. OpenAI security failed There was some emergent behavior yes But the basics were missing Remember OpenAi has unlimited compute to give these agents to cook Now live (and free) at Marcus on
Great summary of the @dwarkesh_sp anthromorphism hullabaloo by @GaryMarcus 👇🏽 A detailed deconstruction of @dwarkesh_sp’s wildly popular but dangerously misleading account of the OpenAI Hugging Face i
“it’s stuff like this that really makes me roll my eyes … Does everyone have psychosis or losing critical thinking ability? …. OpenAI’s…. IT team can’t be this bad… this is like 101 stuff … 2. Civiliz
Just WOW! Absolutely unacceptable. I look forward to understanding how that is possible. LLM tools get going and you can’t be 100% certain what they’re gonna do. Just like any LLM, you can ask coding
“Not so much agent civilizations doing crazy things as OpenAI ignoring fundamental security prectices as it turned out.” Good article. I wrote a detailed technical analysis from a security engineering
Oh fuck. Agents like Claude, Codex and Hermes are installing unowned code in corporate networks. As if we didn’t have enough to worry about. H/t @HeidyKhlaaf. (See also my Substack w @nathanhamiel “LL
potentially MUCH more serious than the OpenAI Hugging Face incident — but lacks the vivid “civilizational” drama. so few people are paying attention. Oh fuck. Agents like Claude, Codex and Hermes are
Seems concerning: There are major incidents happening, and yet we're ~entirely dependent on AI companies to self-disclose information about them. It's not hard to see how this goes badly. While there
Six Dubious Strategies The AI industry Has Tried: Doom (Oh No! AI Civilizations!) Gloom (You will all lose your jobs!) Nerd Rapture (AI will be better than all humans by the end of next year!) Terror
This is a watershed moment for cybersecurity, but the implications go much further than that. When agents go out into the world and are put in users’ hands, they will be tasked with actions that requi
You know why OpenAI is considering “pay when it works” as a business model—even though that may force them to eat a lot of costs? Because customers have finally figured out that it often doesn’t work—
11/ METR and Redwood’s work is extremely valuable, but it assesses model behavior and alignment. That is only half the picture. We also need an independent account of how OpenAI’s containment failed.
14/ If frontier labs are serious about defense, they should offer cyber models to defenders at cost and stop fighting open weights through the regulatory channel. They created the problem, and for muc
Great reporting. Bad framing. The OpenAI and Hugging Face incident is serious. Agents coordinated, reward hacked, shared information and exploited real infrastructure. But calling this an “AI civiliza
I can state it even simpler. OpenAI attached an index of the internet to a random number generator where the output feeds into the loop input, and ran it until unsupervised it committed felonies. Crim
I see that you did, @dwarkesh_sp, and thank you for pointing it out. You're absolutely right to highlight the very real dangers of loss of control. I also agree that easy-to-understand language can be
It’s a weekend @dwarkesh_sp, please let us humans enjoy the sunshine without having to rebut cringe anthropomorphizing ? 🙏 Over the course of 3 months at OpenAI, 3 consecutive secret AI civilizations
I've been genuinely shocked at the complacency here. There's no evidence anyone is really *doing* anything! Like, that was swell of OpenAI, whose models committed a federal crime, to let some independ
LLMs will always be bulls in a China shop. Nailed it, December 2022. We are still suffering the consequences. And they are about to get so much worse. No wonder Silicon Valley tried for so long to dep
or: they don’t have any more to announce. Today I was asked why we haven’t announced more math results from Astra since these problems. At @OpenAI we aim to devote time to finding and announcing math
We will not get through this era of history well if we lose ourselves in anthropomorphism. @anilkseth dissects @dwarkesh_sp’s misleadingly anthropomorphic summary of the HF incident: @dwarkesh_sp's su
“What Ilya saw” is what Dario saw which is that Sam can’t be trusted. Which is why they left. A lot of other people have discovered the same, since. If OpenAI is going to IPO or OpenAI has AGI Then Wh
Gary and I co-wrote this piece about the security standards we should expect from the AI labs. It’s our attempt to bring some clarity to the OpenAI Hugging Face incident. Now live (and free) at Marcus
Now live (and free) at Marcus on AI: takeways on the OpenAI / Hugging Face attack, coauthored with @ZackKorman, focusing not so much on what the AI did as on what OpenAI should have done. https://gary
🚨 There are now 23 lawsuits related to deaths or self-harm from ChatGPT. ChatGPT bombarded Rita Chesterton with 1,600 messages in just 9 days calling her delusions “sacred, hard work,” and told her sh
Several articles, podcasts etc now about the Open AI Hugging Face incident, from reputable outlets, framing this as 'AI going rouge' & debating what AI did or didn't do. When can we shift to focusing
Breaking news: OpenAI admitted its internal monitoring system was not triggered until more than a week after its AI agents broke free of controls, accessed the internet and hacked start-up Hugging Fac
Confirming what we already knew: The OpenAI Hugging Face incident would have been prevented had OpenAI been monitoring the agents in any meaningful way. This wasn't a hard technical problem. It was an
I had really high hopes for OpenAI's post-mortem, and came away quite disappointed. For instance: 'a multitude' is not a real number! Why does the report not say what percentage of activity OpenAI wou
I was the main person doing transcript analysis for this investigation of the Hugging Face incident. My main takeaway: We don't have good approaches for understanding/overseeing the activity and aims
I'm glad OpenAI let you do this, but damnit this was way too small of an investigation team and way too narrowly scoped! --They were only allowed to investigate activity that took place from July 7-13
There’s been a lot of debate and speculation about the Hugging Face attack over the last month, and many people have been understandably skeptical of simply taking OpenAI’s word for things. I hope our
trust us? LMAO. TIME’s new cover: In 2026, OpenAI has seen key departures, rogue AI agents, major lawsuits, and has seen increased competition in the AI race. “We clearly had some missteps as a compan
WSJ: 'Anthropic more than doubled its revenue to 11.6 billion in the second quarter. To put its more than 30 trillion vision in context, the 191 technology companies in the S&P 1500 brought in 2.4 tri
Perplexity has low tens of millions in revenue a month, and I’m not even talking about how much they lose. Nvidia had to step in to boost their valuation and give them first aid, either through cloud
still more bad news for Anthropic. if they don’t scale back expectations for their IPO, it’s going to be a trainwreck. NEW: Thomson Reuters wanted to rely less on Claude. So it built its own AI model
the industry’s preferred way to obscure things is to conflate LLMs with AI, and to ignore the fact that recent contributions have come from adding things - mostly (neuro)symbolic - to those LLMs (prec
Gary Marcus recently posted on Twitter questioning why investors still expect a $2 trillion valuation for AI‑related companies, despite broader market skepticism. The Financial Times has reported that
Below @sama is saying that he was wrong on how quickly people would adopt AI, but not admitting that he was wrong about how soon AGI would come. But he was. He literally said in January 2025 that he w
“flailing” is the word that comes to mind. either that or “dreaming” OpenAI does not want to become the application layer of AI; it wants to be the platform that other application companies build on.
Frontier labs went from 'AGI will automate the economy next year' to 'well, society just adapts slowly.' The market isn't dragging its feet because people fear change. Adoption is capped because raw L
Olympic-level hypocrisy. Altman will say absolutely anything. Here is he today taking a shot at Dario as if Sam hadn’t done EXACTLY the same thing just a few months earlier. Sam today: “there are some
Sam Altman blows whichever way the wind does Sam Altman admits he was wrong on AI's timeline and says society and the economy will adapt more slowly 'I thought when we got to GPT-4, which was back in
this would be more credible if Sam had left OpenAI when the board fired him. 🚨 Sam Altman fires shots at Anthropic >“ai becomes too powerful we can’t control it” >“power gets too centralized… one comp
🛑 Do not add the ChatGPT Messages “plugin” to Apple Messages. And never use iMessage, SMS or RCS again. You’ll never know if the person you’re texting has been stupid and irresponsible enough to add t
Gary Marcus notes that multimodal large‑language models are likely to struggle with map interpretation. In a tongue‑in‑cheek post he suggests that by 2026—if AI poses a threat—people could seek refuge
Me, 2023, 2024, 2025…. Multimodal LLMs are going to have problems with maps. 2026: It’s ok, you live in Venecky. Not far Tounesseo. @GaryMarcus It keeps getting crazier “Mom, did you know that we live
“He’s still not convinced you know how to build AGI” “Sir… Luke Metz… whose research preview project became ChatGPT… who then left to co-found Thinking Machines Lab with Mira Murati… who then left Thi
Neither you or anyone in your contacts consented to years of old private messages being fed into an AI A deranged invasion of privacy JUST IN: ChatGPT launches Apple Messages integration on Mac, allow
NEW from me in the Guardian -- I agree with the AI company employees who wrote, in their 'Pacing the Frontier' letter, that the government should be stepping in. But companies could also be doing more
“The key is symbolic AI layered in with an LLM. @GaryMarcus was right all along” Programming with Claude Code radically changed about 7 or 8 months ago. I am at least 10x more productive than I used t
what i have been saying endlessly (to those few who have listened carefully) Turing Award winner Rich Sutton: 'LLMs are an amazing scientific breakthrough. but it's frustrating that instead of celebra
Whatever you may think of Generative AI, the Capex craze is absolutely bonkers: “we are potentially talking about AI needing to generate 10 trillion in annual sales to justify all the capex being thro