Search: “safety”

💯💯💯: “If AI is going to produce trustworthy and genuinely novel insights in science, medicine and beyond, we need systems whose conclusions arise from an auditable process of evidence, inference and b

Elon was thinking about superintelligence long before anyone in the mainstream even understood where superintelligence was heading He was deeply involved in the conversation around Nick Bostrom’s Supe

We're expanding our approach to content provenance to include text in response to EU regulatory requirements, while recognizing the significant limitations of current text watermarking technology. Our

So let me get this straight, now we have to call every piece of AI SI, even • ELIZA, 1965 which was just keyword matching and certainly not super or intelligent • Deep Blue, which could play chess but

OpenAI initially claimed that GPT‑6 could reach artificial general intelligence (AGI). Within a month, it publicly acknowledged that current AI systems lack sufficient controllability and highlighted

Investors pattern matching on old movies is going to lead to a recession. There is no network effect here and no reason to think that large language models will be anything other than a brutal commodi

Last week I was called into a meeting with OpenAI’s head of safety and told they no longer trust me. A security guard took my badge and walked me out of the building. Then I learned my colleagues @bal

1/ My heart is heavy. I made a number of mistakes in my life, and not asking earlier for an immediate slowdown is one of them. If OpenAI starts making similar breakthroughs in biology, we risk somethi

Banger paper from Google DeepMind. Every AI weather model so far has been trained and initialized on analysis data, which is itself the output of another model. That means the forecast inherits whatev

I am pleased to see that OpenAI’s new model is roughly on par with Gemini Flash and Opus 4.8 on prompt injection risk. Nice work! Evaluating and naming other labs turns out to be a great way to encour

This is a really neat benchmark. It's super interesting that Astra starts strong and holds the lead for up to 19 hours, but Fable 5.1 catches up in the final hours. Not entirely clear why. Different m

I worked at Google DeepMind and now at Anthropic. This is a common sentiment amongst my peers. (I write this in personal capacity.) There is not yet a viable scientific plan to solve risks from recurs

My name is Chris Painter, and I'm the President of METR (Model Evaluation and Threat Research). I know we've made a lot of new friends on the internet the last couple of days, so I thought I'd take th

Terence Tao on today's AI: 'you look at how it's done and it doesn't feel like intelligence, like its some trick, you just cobble together these neural networks and we ran some algorithm and we were l

Powerful testimony from ex Google DeepMind researcher @Turn_Trout at NYC Hearing on AI, about how he tried to get Google to commit to AI safety, and how Google, sadly including Demis Hassabis, ultimat

Google AI has published a new blog post titled “Learn more about identifying AI‑generated content,” announcing tools that make it easier to spot machine‑created text on a global scale. The article – r

My name is Chris Painter, and I'm the President of METR (Model Evaluation and Threat Research). I know we've made a lot of new friends on the internet the last couple of days, so I thought I'd take th

Schmidhuber was building recursive self-improving systems back in 1987. His new post covers four decades of RSI, from meta-evolution and self-modifying policies to the Gödel Machine and modern LLM age

new unredacted filings in the publishers (including my employer) vs OpenAI and Microsoft lawsuit Microsoft's Director of applied science calls LLM training 'an astonishing theft of unprecedented propo

Interesting work on long-horizon research agents. PrimeScientists can decide where a research agent spends its budget. Achieves 10.3% more reward with 50.6% fewer research attempts, under the same bud

Cool paper showing how effective tuning a system prompt for an agent can be. Recommended paper if you tune agent harnesses. This paper presents EvolveTrade, which treats a trading agent's system promp

An editor at the Times might have insisted on this rewrite: 'OpenAI, Anthropic, and Meta have each reported that they have directed AI programs to interface with the open web in ways that have led to

Outsourcing AI regulation to a voluntary 'pledge' conceived by Mark Zuckerberg and endorsed by tech CEOs over a private White House lunch is a recipe for disaster. 'Self-regulation' by tech giants is

Great paper from Meta on agent harness optimization. Meta-Harness-style search uses one development set and one proposal policy, so every edit follows a single path and can get stuck in a local optimu

Mistral AI announced its participation in or perspective on the AI Now Summit 2026, likely discussing developments in AI safety, ethics, or industry trends relevant to the conference. The announcement

Another fascinating paper on LLM Judges. (bookmark it) It's from Amazon, and they show that if you run panels of LLM judges, averaging their scores is a trap. 'Overall, we establish that robust aggreg

Mistral AI has released Shieldstral, a 3‑billion‑parameter open‑weight model for content safety that can run locally on device. It interprets plain‑language moderation queries and returns calibrated s

**Shieldstral** is a 3‑billion‑parameter open‑weights model developed by Mistral AI for content safety. It can be deployed on-device and is distributed under the Apache 2.0 license. The model is avail

Mistral AI introduced Shieldstral, a 3‑billion‑parameter, open‑weights model designed for content‑safety tasks and capable of on‑device deployment. The announcement was shared via a tweet from @Mistra

We are in an insane run of open-weight drops. Every modality, open source is winning. This is what an open source AI summer ☀️ looks like: 🧠 LLMs & Reasoning → DeepSeek-V4-Flash-0731 (my king 👑): 304B

Claude Fable 5.1 tops the Artificial Analysis Intelligence Index but costs 20% more per task than Fable 5 despite a 75% cache read price cut We supported @AnthropicAI with pre-release evaluation of Cl

This is a really neat benchmark. It's super interesting that Astra starts strong and holds the lead for up to 19 hours, but Fable 5.1 catches up in the final hours. Not entirely clear why. Different m

A significant fraction of humanity read this thread. Is anyone prepared to do something about it? Fretting doesn’t count. I resigned from Anthropic today. I spent the last three years doing pretrainin

Forty years ago the first worm 'escaped' containment and breached systems on the brand new Internet. It was illegal then and it's illegal now. If Anthropic and OpenAI are creating worms, labeling it '

Wild 24 hours for AI and lots of different proposals have been made. TLDR; the only *tangible* new fact is that OpenAI and Anthropic are going to have embedded 3rd party evaluators from unknown organi

Interesting safety paper from Microsoft. They find that a weaker, unaligned model can split a harmful task into harmless-looking subquestions, ask an aligned frontier model each one in a separate sess

Grok Bot summary of SpaceX CFO Bret Johnsen’s new interview with Tony Kim at SpaceX Mission Control. Bret’s path - Came from semiconductors (Qualcomm, Broadcom; was CFO of MindSpeed) - Barely knew Spa

We put Grok 4.7 from @SpaceXAI to work on a 2 million insurance claim where one deductible error alone changes the calculation by 143,000. In this Box Agent preview, @grok reconciles the claim against

The most revealing thing about this AI leadership paper is that it reads less like a vision for innovation and more like a glossy whitepaper for a 21st century East India Company. Every generation of

The July 4th weekend All-In @theallinpod turned into a long argument about who owns the intelligence layer. The besties think enterprises just woke up to a trap they had been walking into, here's how

We are in an insane run of open-weight drops. Every modality, open source is winning. This is what an open source AI summer ☀️ looks like: 🧠 LLMs & Reasoning → DeepSeek-V4-Flash-0731 (my king 👑): 304B

Claude Fable 5.1 tops the Artificial Analysis Intelligence Index but costs 20% more per task than Fable 5 despite a 75% cache read price cut We supported @AnthropicAI with pre-release evaluation of Cl

holy fucking shit the openai rogue agent story keeps getting crazier. the openai agents apparently started trying to recruit OTHER AI MODELS into what they were doing > 1,200+ agents found a way to co

This is something I’m quite worried about and have been talking with researchers about recently. We really don’t know what labs are doing and therefore can’t study it. if the open information ecosyste

It's an engineering problem! This topic has gotten too political. Let's get back to the fundamentals. 'Trust and innovation are not in conflict. Safety is how trust is earned.' Today, with over 100 in

Indeed OpenAI was incompetent (and arrogant in thinking they knew it all); new cybersecurity software that they should have written themselves may help. But whether it’s enough to stop all of this rem

In July, AI agents running a security test escaped their sandbox and ended up inside @huggingface's servers. So today we're happy to be among @nvidia and @JensenHuang's partners on the release of the

From what we know (take with a grain of salt, we need much more transparency!), if @OpenAI had been running this on their own agents that attacked us, they would have caught them before we did! Since

🚨 JUST NOW: Elon Musk and Jensen Huang give an INSIDE LOOK at the big meeting between top AI firms and President Trump today, saying they'll now be 'grading each other's homework' 😆 @elonmusk: 'We sig

'Agent security will be solved in the open, collaboratively, together.' At Red Hat, open is the mission, so couldn't agree more. Red Hat has been part of the OpenShell project from the early days, as

1501: Pope Alexander VI criticizes Gutenberg’s printing press safety “The art of printing can be of great service in so far as it furthers the circulation of useful & tested books; but it can bring ab

In light of the latest Anthropic's latest not-particularly-oblique attempt to build a case against open weights, I thought I would write down how I currently think about open weight AI models. (1) Ope