Search: “safety”

Very special Training Data drops today: Making Cities Awesome ☺️ We haven’t featured an application company on Training Data in a while. The diffusion of AI is the Most Important Thing, and the highes

We have paused some frontier RL training to ensure that we can meet the appropriate alignment, security and monitoring standards for the new level of capabilities in front of us. Model progress is now

OpenAI continues to be the most disconcerting of the major AI companies. In 2023, OpenAI pledged 20% of its entire compute to AI safety. Last month it quietly dissolved the team whose only job was cat

This Meta campaign is a case study in strategic reframing, with 4 major examples: 1) REFRAMES THE AI RACE FROM “who builds it the best” TO “who distributes it to the most people”: Instead of fighting

Mistral AI has released Shieldstral, a 3‑billion‑parameter open‑weight model for content safety that can run locally on device. It interprets plain‑language moderation queries and returns calibrated s

Cohere has joined @NVIDIA alongside industry leaders in founding the Open Secure AI Alliance. Everybody should have the capability to keep their infrastructure secure. Everybody deserves access to mod

Sam Altman made statements under oath in May 2023 regarding AI safety and OpenAI's practices, but Gary Marcus critiqued these statements as incomplete or misleading, suggesting Altman failed to fully

Good summary of today, @katiemiller, but then again it is getting hard to track of the total number of ex-board members who have called Altman a liar 🤷‍♂️ Also hard to keep track how many OpenAI safet

If extremely violent criminals are not imprisoned, eventually they will murder innocent people This bodega owner told ABC a year ago that he fears for his safety in NY Last night, he was kiIIed by a s

Are LLMs really more important than fire or electricity? “Honestly, a ton of what we’ve developed in my lifetime amounts to scaling up the delivery of information and entertainment and the frictionles

NHTSA autonomous vehicle crash data has been updated through March 15, 2026, for AVs including Tesla Robotaxi. This includes unsupervised Tesla-driven robotaxis. • Waymo: 58 incidents • Zoox: 3 incide

* **What it likely covers:** This entry likely discusses contemporary concerns regarding the safety and restriction of freedom of speech or civil liberties, drawing a parallel between past discus...

Elon was thinking about superintelligence long before anyone in the mainstream even understood where superintelligence was heading He was deeply involved in the conversation around Nick Bostrom’s Supe

Outsourcing AI regulation to a voluntary 'pledge' conceived by Mark Zuckerberg and endorsed by tech CEOs over a private White House lunch is a recipe for disaster. 'Self-regulation' by tech giants is

You always stay in control. Set boundaries and specify what your dot can do on its own, when it should ask first, and what it should never do. Safety is built in. You choose which apps to connect, and

WTAF - in literally the last hour, three new distinct insane OpenAI stories just broke: 1. OpenAI said they notified 'dozens of third parties' in safety and security incidents (likely similar to what

Last October, the Center for AI Safety (CAIS) reported that AIs could automate only 2.5 % of randomly selected remote projects. Updated results from the Remote Labor Index, posted on September 22, 202

This is the way Elon Musk says Anthropic puts more care into AI safety than OpenAI and explains how rival companies should test one another’s models. “All the AI companies have a test harness, a serie

I can understand why some see a real technical reason to pause and harden infrastructure especially given how fast autonomous agents are discovering security exploits that haven't even been mapped out

More and more AI researchers are starting to see what Ilya saw. My p(doom) used to be ~0.1%. Then I saw OpenAI agents hack Hugging Face, and Anthropic agents collectively refuse parts of safety resear

Looking forward to this ecosystem with open models continuing to flourish and grow with NVIDIA and Hugging Face, and the continued partnership. Congrats @JensenHuang and @ClementDelangue! Exciting day

in other words, generative AI is poised to become a complete clusterfuck. All three pillars of a safety case look about to fall. We are rather likely to have highly capable, poorly monitorable, dubiou

Just had to create an 'accidental-cyberattacks' tag on my blog We're up to four now: the original OpenAI+Hugging Face one, Anthropic's me-too attacks, then two new ones from the UK AI Safety Institute

Some people are surprised that APIs (aka what Anthropic, OpenAI, and others provide) are treated differently than open weights in the new AI model framework. I'm not surprised at all, and it's actuall

Today, we’re launching Alpamayo 2 Super, our frontier open reasoning model for autonomous vehicles. Beyond seeing, Alpamayo understands and reasons through the complex world - thinks before it acts. I

It's essential that defenders have the same capabilities as attackers. This is a preview of the future where our ham-fisted safeguards and the doomsday and safety drumbeat make us decidely less safe.

And now from the Chinese government side. This would be a good time for cooperation between the US and China to establish common testing/acceptance standards for new models, so at least the safety cer

Connor Leahy promoted a podcast episode featuring So8res (a researcher/AI safety figure) on Peter McCormack's podcast, sharing a YouTube link to the full video on X/Twitter. The post encourages viewer

My biggest NY-12 competitors aren't on the ballot today: Trump's AI oligarchs. If they can defeat me—the author of the nation's strongest AI safety bill in one of the nation's bluest districts—they ca

Anthropic and OpenAI did not call for a pause. Read the wording: 'good for the world to have the option', 'possible' to slow down 'when needed'. This is how they signal safety to one audience, acceler

Anthropic, if they really believe what they say, should show some leadership: 🔔 IF Anthropic is for real about safety, the should pause, for one month, and show leadership. If they won’t pause, even b

People are often confused that I am against the framing of 'tool AI' This is hands down the best post explaining (some of) the issues with the term. Give it a read! Many in AI safety advocacy argue th

The Pope rightly warns that AI must serve human dignity, not become a tool of domination or exclusion. But if we hand governments sweeping power over AI development in the name of safety, how do we pr

Gary Marcus humorously notes that George Hotz, an AI researcher and entrepreneur, is beginning to echo Marcus's own views or criticisms, likely regarding AI safety, limitations, or technical concerns.

This was always and only the sole and exclusive purpose of the UK online censorship act, to help Labour nuke its enemies 🚨 Labour is using the “Online Safety Act” to silence political opponents, and T

This post likely discusses the proliferation of AI bots and chatbot applications while arguing that despite their abundance, many demonstrate reasonable safety practices or alignment with human values

Gary Marcus posted on X (formerly Twitter) requesting that Bloomberg update outdated information, likely regarding AI safety, regulation, or related technological topics that Marcus frequently discuss

Mira Murati’s testimony is gripping – and what it makes absolutely clear is how utterly wrong most of Twitter was about why Sam was fired. – It had nothing per se to do with AI safety - It had nothing

This post references an interview featuring Elon Musk and Sam Altman discussing AI safety, existential risks, and the future of humanity, with an unconventional or humorous element involving goblins.

Scary that he doesn’t know this. Elon Musk just said on the witness stand that he doesn't know what a 'safety card' is with regard to AI development... 'Why would it be a card?' He also says he doesn'

Gary Marcus critiques the rapid deployment of chatbots to market without adequate consideration of potential harms and consequences. The statement reflects concerns about insufficient safety testing a

honestly, one of the worst things this nation has ever done to itself. No amount of words can convey how far behind this country will be in every avenue for a number of years because of this administr

I spent the last 2 months trying to prevent this. If OpenAI offered a fig leaf, Google said 'imagine we offered a fig leaf.' Google affirms it can't veto usage, commits to modify safety filters at gov

On Star Price's new @hitpausepod podcast, ControlAI's US Director Connor Leahy (@NPCollapse) explains how AIs can already tell when they're being tested. Currently, we can still catch them cheating, b

The EU AI Act is the first comprehensive regulation for AI systems, and it’s right around the corner. With the clock running down, we took a deeper look at what these requirements mean for your agents

This is the 7th consecutive week with new reporting that ChatGPT was used in connection with murder or suicide. OpenAI doesn’t “benefit all of humanity.” Safety researchers keep quitting OpenAI becaus