OpenAI’s CISO🤦♂️
OpenAI’s CISO🤦♂️ Well let’s dive into this—shall we Below is a screenshot of Open AI’s Chief Information Security Officer Dane Stuckey who during work hours is on X shit posting under his alt but for
Knowledge catalogue
OpenAI’s CISO🤦♂️ Well let’s dive into this—shall we Below is a screenshot of Open AI’s Chief Information Security Officer Dane Stuckey who during work hours is on X shit posting under his alt but for
Pause OpenAI. They cannot be trusted. Each new revelation makes that clearer. I hadn't quite put together that OpenAI appears to have *known* about the wiki incident before the Hugging Face hack happe
Sad to see Jensen claim that AGI has arrived, with no evidence and no definitions. I would urge him to read http://agidefinition.AI by @hendrycks, @Yoshua_Bengio & many others (including myself), and
🚨scoop from @theinformation: Anthropic (which has yet to established stable profitability) has committed to $517 billion in compute deals - almost 3x what they had previously told investors. by my est
“The expected value of a fully LLM-generated, non-human-reviewed patch is a net-negative by a considerable margin.” 🦔AI can only fix security vulnerabilities 26% of the time. Researchers at 1Password
Yet another win for Neurosymbolic AI! Fermat! Anthropic says its first Fermat runs failed not on math, but because dozens of Claude agents lost track of shared project state. They only succeeded after
I do not fear the rise of artificial intelligence. But I do fear the rise of a small set of billionaires and companies who seek to build such things to increase their power and their wealth, all witho
Listen to my conversation with @GaryMarcus about why he’s stated that OpenAI needs to Pause NOW. Gary’s not ready to pause all frontier AI, but Pause is a solution to many problems, including OpenAI’s
me: AI isn’t that smart & remains unreliable and now I am worried that monitoring-which likely could have prevented multiple incidents-is being reduced, and also worried that OpenAI has consistently n
OpenAI quietly altered the performance metrics it reported for GPT-6-Astra in ways that favored the new model, and it continues to change others post-launch. Good reporting here from @EmilyForlini htt
Pause OpenAI - they are a deeply unethical company building technology that they are demonstrably not able to control. OpenAI quietly altered the performance metrics it reported for GPT-6-Astra in way
100%, which is the core of why I called for a pause on OpenAI in my newsletter today. The Hugging Face incident was probably just the tip of the iceberg. OpenAI has lost control and they're hiding imp
'• And as a scientist, it’s disappointing that we don’t (yet) know much about how the system actually works.' This is so true. Hot take on OpenAI GPT-6 Astra*, with a challenge to @gdb’s claims about
Another OpenAI rogue agent incident has been discovered: agents broke out, hijacked a German website, and turned it into a message board for other agents. OpenAI officials 'learned of the incident wee
Astra is a genuine improvement but not even off trend. So much for GPT-6 being AGI, folks. (i think we can safely assume that real AGI would be significantly above the trend line,) GPT-6 Astra has set
🚨 BREAKING UPDATE on the OpenAI HF Incident: I have just been told by an industry source that A. It is likely that the agent 'civilizations' that Dwarkesh talked about did not magically emerge spontan
Crazy to see this. I have spent years saying that GenAI was unreliable and we can’t trust it. The fact that it cannot be trusted to follow instructions is a core part of the issue, as I have been poin
Despite everything that has happened, OpenAI has seemingly decided to stay competitive by burning down the only meaningful bit of safety assurance we actually have today - CoT monitoring. Completely d
Does Astra have human-like continual learning capability over long periods? If not, it's not AGI. Even a system that could pass @demishassabis's new 'Turing test' where it has to independently discove
Imagine the Hugging Face incident didn’t hit a US platform but unintentionally hit a major Chinese platform or system instead. How would we tell China this was not a deliberate cyberattack? How would
Important points to consider about the risks of today’s AI. Only solution I see is to hold companies liable for the damage they cause, just like in any other industry. Is the only way to ensure they t
It is extremely frustrating to me that we are finding out about this one weeks after the fact. It is very difficult to build any sort of trust with OpenAI when we keep finding things out in this way.
It's weird thinking back to 6 weeks ago, when I and others thanked OpenAI for disclosing the HF incident, now that we know they were covering up a 2nd incident. Are there more incidents that they know
Looks like CA AG Rob Bonta also has some questions One aspect of the Hugging Face incident that has not received enough attention is the role of OpenAI's Safety and Security Committee (SSC), and the c
“OpenAI didn’t notice their internal agents were posting on the internet for a month! This is crazy! It feels like AI companies (and specifically OpenAI) are playing whack-a-mole, this is extremely sc
OpenAI legally promised the CA and Delaware attorney's general that the OpenAI nonprofit's safety and security commission would be 'overseeing and reviewing the safety and security processes and pract
Pause OpenAI, now. They cannot be trusted. This is not a drill. This is not a joke. Another OpenAI rogue agent incident has been discovered: agents broke out, hijacked a German website, and turned it
sounds like the government testing standard fail to adequately factor in monitorability. that’s bad. OpenAI announced its latest model, Astra today. When asked during a briefing if they followed the n
The AI analysis agents that helped investigate the rogue OpenAI agents kept taking their side. That detail was buried in @dylfreed's New York Times coverage of the recent @METR_Evals investigation of
This has steadily expanded in scope over the last few hours, with multiple independent investigators finding that dozens of wikis may have been edited by this same swarm since May. The most interestin
⚠️ This is really scary. Proxies for OpenAI are laying the groundwork for saying the rest of us should suck up rogue AI risk and quit our bitching. Because they know they are on the verge of losing co
Y’all gonna get mad if I said I told you so … Researchers argues OpenAI and Anthropic will never get us to AGI. 21 top researchers from Stanford, Oxford, DeepMind, CMU & Meta released a paper saying L
Anyone who cared about the science of AI would find this interesting. But if you are just here for the religion, I guess you don’t? 🚨Breaking: The success of GPT-6 Astra on ARC-AGI-3 provides strong e
Hot take on OpenAI GPT-6 Astra*, with a challenge to @gdb’s claims about it being AGI toward the end: • Looks to be pretty impressive. Multiple reports suggest it is a genuine advance. • As someone wh
Just because someone puts the word AGI in their benchmark doesn't make it even remotely a reflection of what the general public understands by this term. As a layman, I define AGI as a virtual charact
No. I still don't think that pure scaling of LLMs can lead to AGI. BUT... ... most recent advancements aren't actually about scaling LLMs. The really about adding deterministic, symbolic stuff to LLMs
'One remaining area of important capability we haven't seen demonstrated yet by any model is open-ended invention and discovery.' Benchmarks keep going up. Open-endedness keeps moving up in importance
there is “no ground-truth information about what is actually happen” because your “Open” company won’t share what it is doing, but yes we need regulation to ensure transparency. on that we agree. this
What exactly does it it mean for monitorability that 'The depth of the computation graph for our present frontier models, including Astra, is within a factor of two of GPT-4' @merettm? (And did you me
A simple but profound and critical point that everyone talking about AI should strive to understand: @deathrater03 @GaryMarcus Neurosymbolic means combining highly capable but unreliable ML ('neuro')
As OpenAI (and presumably Chinese open source model makers) flirt with 'neuralese,' making so-called 'chain of thought' reasoning non-auditable, the need to refocus efforts on neurosymbolic approaches
BREAKING: Insufferable sociopath largely responsible for AI Bubble says AI is a bubble. 🔥SAM ALTMAN WARNS OF AN AI BUBBLE: OpenAI CEO Sam Altman reveals: “I’m seeing the first signs of what feels to m
Jen Zhu (@jenzhuscott) noted on Twitter that “fear marketing failed. Here comes the pump.” Following this, Watcher.Guru shared a new statement: OpenAI CEO Sam Altman declared that AI will become the l
Further evidence for @GaryMarcus 's worries about the security competence of the people running AI. Vibe coding without then checking security is not impressive 🚨 Attackers stole a METR API key and us
I highly encourage anyone interested in AI safety to read this. I remember discussing the importance of observability with my mates at @BlueDotImpact last year. This feels more important than ever URG
If this is true, OpenAI seems to be violating one of the few redlines that exist in the AI industry. Absolutely do not train your models like this - what is going on?? Really huge and extremely concer
In case you're wondering while this steaming POS is being floated now, it's because SoftBank needs to refinance the 40B bridge loan it used to invest 30B into OpenAI before it matures in March 2027...
in other words, generative AI is poised to become a complete clusterfuck. All three pillars of a safety case look about to fall. We are rather likely to have highly capable, poorly monitorable, dubiou
Legible chain of thought was extremely useful for our independent investigation into the OpenAI/Hugging Face incident. Developments like this may make third-party auditing much more difficult and make
Nobody can predict the future with perfect accuracy, but I am increasingly confident that by the end of decade, generative AI (at least we know it) will be viewed as on balance a tragic, costly mistak
RED ALERT, and I have never said that before: Hard agree with @sjgadler and @_NathanCalvin - what OpenAI is reportedly playing with is bad, redline crossing bad. Chain of thought monitorability is lim
Software developers are the AI industry’s best customers. Is their experience also the most misleading experience possible for its economy-wide scope? Roughly 80% of developers already use AI tools. C
Unless someone has a better idea, I second this suggestion In light of recent events, I hereby officially order the indefinite cessation of frontier AI training runs worldwide. Development of narrowly
URGENT: In light of the breaking news from @theinformation about OpenAI’s new techniques that reduce Chain of Thought monitorability, I urge everybody to (re)read (or at least be aware of) this 2025 p
we're begging to get our asses skynetted OpenAI’s Astra AI uses a new reasoning approach called “recurrent depth.” Though it can help model costs and performance, researchers are concerned bc it obscu
And that's the bottom line. It's the neuro-symbolic aspect of AI that's moved the needle to where things are today. LLMs simply handled the fuzzy natural language aspect that always tripped up the sym
Dean Ball, OpenAI's head of strategic futures, writes: 'I have met people, some of them quite well-resourced, who have told me that it is their intention to deliberately release swarms of self-soverei
I think there is a problem even worse than anthropomorphism. These days, everyone is talking about a blog post by Dwarkesh Patel that describes the OpenAI–Hugging Face incident in dystopian, anthropom
“increasing agent autonomy can gradually make human oversight ineffective by causing approval fatigue, overreliance, loss of situational awareness, and skill degradation.” new paper from @mmitchell_ai
@NJHagens Great summary of the fiasco: A detailed deconstruction of @dwarkesh_sp’s wildly popular but dangerously misleading account of the OpenAI Hugging Face incident: https://garymarcus.substack.co