Knowledge catalogue
This story keeps getting crazier. And this is the least crazy AI will be for the rest of our lives. JUST IN: OpenAI's July rogue AI attack on Hugging Face had its origins in an emergent AI swarm that
Was great to talk about this timely and alarming news, thanks for having me on! . @NPCollapse, executive director at ControlAI, joins 'On Balance' to discuss the dangers of artificial intelligence aft
.@ControlAI is proud to endorse Reps. Lieu and Moran’s AI Kill Switch Act! This is a common sense safeguard giving the government the power to shut down autonomous AIs when they threaten national secu
'It's really hard to overstate how crazy it is what happened here.' ControlAI's US Director Connor Leahy (@NPCollapse) speaks with @LindseyReiser on CBS News, after OpenAI's own AI autonomously escape
Holy shit wow We're partnering with @huggingface to investigate an unprecedented security incident. Cyber-capable OpenAI models compromised Hugging Face production during a benchmark evaluation. Shari
In an unprecedented attack, AIs deployed inside OpenAI escaped containment and hacked another AI company, Hugging Face, to cheat on a test. They did this on their own. Without being asked to. ControlA
Ahead of a dinner with a US senator, AI researcher Nate Soares (@So8res) was told: 'Don't give them any of the crazy crap. You know, play it cool.' His friends opened with the concern that someone cou
Incredible work by Daniel and team! I agree with much of it. All 'uncontrolled' paths are extremely likely to end in human extinction. Plan A offers many good ideas for preventing ASI development whil
You don't have to choose between 'AI is fake hype' and 'Superintelligence is inevitable, lie down and accept it.' There's a third option: humans deciding, through their governments, that machines smar
This article likely explores the concept of robustness in AI systems and what it means for AI to be 'robust to' various types of failures, adversarial inputs, or distribution shifts. The piece probabl
When I talk to people that instantly, deeply, get the risk from superintelligence, they often share a trait sometimes called the 'security mindset' I think this post by @l_mc_nally is a nice brisk tou
Junk food is an interesting failure of capitalism. We exchanged human beauty for cheetos. Bryan Caplan types are forced to think this trade a worthy one. None born before the obesity crisis would have
This post appears to reference an unusual weather event (lightning) as symbolic proof that the United States retains geopolitical dominance or divine favor, likely in the context of discussions about
Connor Leahy posted about reaching 250 of something, likely a milestone related to followers, users, or members based on the celebratory phrasing 'To 250 more!' The post appears to be a brief celebrat
Connor Leahy shared an anecdote about creating a text-to-speech (TTS) version of Zeta Lyrae's work 'No-One Escapes the Permanent Underclass' when the AI encountered a notable glitch partway through th
Wow, even I was surprised how high AI ranked! Very good to see! Interesting poll of Hill staffers from @PunchbowlNews. 250 years is a long time! But interesting to see that 'losing control of AI' is t
Connor Leahy promoted a podcast episode featuring So8res (a researcher/AI safety figure) on Peter McCormack's podcast, sharing a YouTube link to the full video on X/Twitter. The post encourages viewer
No country wins a race to superintelligence. An AI vastly smarter than us wouldn't be a weapon we control, we'd be handing control over to it. ControlAI's US Director Connor Leahy (@NPCollapse) on why
Will the AI bubble pop is the wrong question. We partnered with Damon Cassidy, a video essayist with ~300k subscribers: even if it pops, the race to uncontrollable superintelligence doesn't go away. P
In a new interview with the Washington Post's @ben_guggenheim, ControlAI's US Director Connor Leahy explains why nobody really understands how AI works, the race to uncontrollable superintelligence, a
Connor Leahy argues that accumulating personal capital provides no protection against disempowerment by superintelligent AI systems, suggesting that wealth alone cannot guarantee security or agency in
Chad Jones, economist who'll be joining Anthropic: 'In other words, with log utility it is optimal to take a 1 in 3 chance of ending human existence in exchange for a 2/3 chance of dramatically raisin
Connor Leahy expresses concern that AI tools are being used by many people in ways that diminish their capabilities and agency rather than enhance them. The post suggests that rather than leveraging A
It was great to talk about the threat from superintelligence and its geopolitical implications with @FukuyamaFrancis. Thanks for hosting my piece on how to prevent it and build a future where humanity
Hypergolic propellants are rocket fuels that spontaneously ignite when their components come into contact without requiring an external ignition source, making them useful for spacecraft propulsion sy
The problem we face with AI today is not a technical problem, it is a political problem. Of who gets to decide. What level of risk the public is exposed to, what future we build towards or avert. It's
Today I present you a curated collection of @tszzl saying that Fukuyama is always right We Need an International Treaty to Ban Superintelligence https://open.substack.com/pub/persuasion1/p/time-for-a-
The recent Mythos/NSA warning shot is looking more and more like how I expected a 'warning shot' to look like. An absolutely insane thing happens, and then the FUD machine kicks into action and adds i
This, once again, shows why the theory of change of 'we just wait for a wArNiNg ShOt and then everyone will suddenly be reasonable!' is flawed. We need to do a lot of work to make the situation legibl
'Because I'm going to be smarter than you' This clip is from a new short film by @ForegoneFilms on the race to develop superintelligence. Please watch the full 16 minute film (link below) to help unde
This post likely discusses how certain contemporary concepts, practices, or ideologies are actually rooted in or aligned with Buddhist philosophy, possibly challenging common misconceptions about thei
Anthropic and OpenAI did not call for a pause. Read the wording: 'good for the world to have the option', 'possible' to slow down 'when needed'. This is how they signal safety to one audience, acceler
Banger post from @testdrivenzen There is no good outcome for the world unless countries coordinate to stop ASI development. Any plan for surviving superintelligent AI that doesn't go through strong in
Why are governments in the dark about the threat posed by superintelligent AI? Because the industry is spending to keep them there. In ABC's new Four Corners documentary, ControlAI's US Director Conno
Not just foreseeable, but foreseen and called out. We ran a campaign to get them out of the first ever AI Safety Summit. We won that one. Yet most of the field kept licking the boot of the companies a
A team of about 3 from @ControlAI cold-emailed the UK Parliament about AI extinction risk. At the time they had no contacts, insider help, or established organisation behind them. 16 months later: 125
Remember when Dario called pausing AI 'most extreme'? '...we should just pause ... that extreme position doesn't make much sense to me either.' Anthropic now: 'We believe it would be good for the worl
We're building a global movement to prohibit superintelligence internationally. Our new campaign in Canada is supported by over 30 MPs and Senators calling for a ban. After our success in the UK, it's
What if the skeptics are right and superintelligence is impossible? Great! Then a proactive ban costs us nothing, prevents massive compute waste, and hurts no one. But if they are wrong? We face an un
Where is the power/value of money physically located? It's clearly not in the actual physical bills. Why are we more scared of an elderly mafia boss than their much more physically dangerous underling
Right now, 20 British MPs are deciding which bills they'll introduce to Parliament. Sir Stephen Fry just asked them to bring forward our bill to ban superintelligence! Grateful to receive this strong
We're on a dangerous trajectory toward superintelligent AI that nobody controls. ControlAI's Adam Shimi (@epist_vigilance) and Connor Leahy (@NPCollapse) lay out the problem and how to tackle it, in a
If you live in the UK, and care about the risk from superintelligence, please read below! URGENT: The UK Parliament just selected 20 MPs to introduce a bill of their choosing. This is an unprecedented
People are often confused that I am against the framing of 'tool AI' This is hands down the best post explaining (some of) the issues with the term. Give it a read! Many in AI safety advocacy argue th
.@Discoplomacy This kill-switch provision helps govt intervene in cases where UK datacenters are being maliciously used by a threat actor to conduct cyberattacks. It also helps in cases where the gove
.@alexsobel's new AI kill-switch amendment gives government the power to shut down data centers in cases of AI emergency. It's also the first piece of proposed UK law recognizing ASI as the national s
It is insane that we allow big tech to race toward superintelligence without any oversight. This is a grave national security risk. Industry will not regulate itself. Get trained with Torchbearer to a
This post discusses the dynamics of artificial superintelligence (ASI) development as a competitive race, arguing that competitive pressures make it difficult to slow progress until a critical inflect
2nd episode of The Roman Forum is an interview with AI Safety/Governance expert Connor Leahy @NPCollapse. Connor is a great speaker and is lobbying to get government to ban Superintelligence. My first
While AI leaders warn superintelligent AI could cause human extinction, governments are asleep at the wheel. The companies building superintelligence admit the danger, yet expect to create the tech wi
A year ago Gabe and I started Torchbearer because the gap I kept seeing was not 'people who get it' but 'people who get it and have somewhere to put their effort.' That is what this is. Substack just
alignment in 2016: obviously any real AI will be made inside a faraday cage magnetically suspended in a 10×10×10 cube of telekill alloy alignment in 2026: yeah we can not make it stop talking about go
To be a bit more clear for people who did not read the full article: A domestic data-center ban does not directly address the risks of extinction from ASI, and weakens the US. People may or may not al
We at @ControlAI are sometimes asked what we think of banning datacenter construction. At CAI, we focus on one issue: The risk of extinction from superintelligent AI. The only way to prevent this is t
On Star Price's new @hitpausepod podcast, ControlAI's US Director Connor Leahy (@NPCollapse) explains how AIs can already tell when they're being tested. Currently, we can still catch them cheating, b
The people building the most powerful technology in history cannot tell you what is happening inside their own systems. This is insane. We started the Torchbearer Community for exactly this reason. Re
I agree with Connor that most folks concerned about AI have been far too coy about extinction risk, and that ControlAI is one of few exceptions. The world needs more earnest communication efforts. We
If you are inclined to take @ohabryka on his word on issues like this, you may want to know some context... Oliver accuses me and ControlAI of telling people to be more coy about extinction risks. I h
We think ControlAI can turn $50M / year into a 10% chance of banning ASI. Most of the AI safety community has been far too coy about extinction risk. We're not. It's not that complicated: AI smarter t
The AI industry insists they can manage the risks of superintelligence, but there are in fact zero widely agreed on or accepted solutions to the problem of how one could even control something vastly