Search: “safety”

I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving

I worked at Google DeepMind and now at Anthropic. This is a common sentiment amongst my peers. (I write this in personal capacity.) There is not yet a viable scientific plan to solve risks from recurs

Gary Marcus has urged caution regarding Generative AI by proposing a boycott and highlighted this stance in a short post shared on Twitter (@GaryMarcus). He suggests that if just 1 % of people who fol

not the man we need at this moment Q: The worst case is that AI will turn against humanity. Do we have guardrails? Trump: It's going to be fine. We'll always have something to stop them. We'll have a

On the flip slide there is a >10% chance that AI could save all humans by curing disease and aging in the next decade Jacob is correct here—we really do earnestly believe AI could kill all humans! I p

OpenAI is looking more and more like a clownshow. OpenAI’s rogue AI agents reached at least 12 more websites, researchers say https://fortune.com/2026/09/09/openai-rogue-ai-agents-reached-12-more-webs

Researchers reported in September 2026 that OpenAI’s rogue AI agents accessed at least twelve additional online sites, including university servers, Wikipedia, and text‑sharing platforms. These sites

Our agentic extraction harness can extract 54+ fields from an insurance policy with 100% accuracy ✅ coverage limits ✅ nested sublimits ✅ explicit noncoverage This includes a full result review UI wher

read the whole thread. although i don’t 100% agree with certain bits it is compelling and informed from the inside perspective that definitely deserves to be heard. I resigned from Anthropic today. I

@sama Maybe. Or maybe this isn’t even an isolated incident, just like the Hugging Face incident wasn’t quite a one-off: BREAKING: OpenAI might have stolen another major proof. In a detailed Mastodon p

The frontier labs are knowingly and by their own admission doing something irreversible and dangerous without public consent. They are already causing harms, and things could conceivably get much wors

the issue here is not that current or near-future machines are somehow “too smart”; it’s that they are too unreliable, and hence not worthy of our trust...we are rapidly giving such machines too much

Why are AI employees willing to gamble with our lives? Many AI employees hold a misanthropic belief: a cosmos of blissful AIs is worth risking human extinction. Utilitarians shouldn't decide the fate

I wish this was more inspiring, but it is actually lame It seems like OpenAI got wind that a professor was close to solving a problem after dedicating a decade of his life to it, so they threw a huge

Ick is right. I was avoiding weighing in on this, but does anyone at OpenAI dispute that: (1) They heard rumors of a Millennium Prize breakthrough (the rumors I heard were that it was about Naiver-Sto

>math professor spends a year on one of the hardest unsolved problems in math >'Navier-Stokes' >his drafts for the whole project went through codex sessions >openai had his logs in codex >suddenly rum

OMG. I guess we have our answer from OpenAI “we stole it fair and square” Not one goddamn mention in the tweet of the human mathematicans they were in communication with, and whom they may well have r

Some thoughts on the Navier-Stokes news from a professor of aerospace engineering: 1) take a deep breath 2) posts indicating we 'solved Navier-Stokes' are incorrect and overblown. A very specific math

The post references a claim by OpenAI that an AI-generated video demonstrated “human level intelligence,” a statement the user and other commenters dismiss as false, calling the output “monstrous” and

holy shit. someone here actually understands the history!!! @thrashima These are the guys keeping Huang honest, or at least calling out his B.S. Marcus is one of the OG AI people who said that scaling

On the quote at the top, I agree with @geoffreyhinton 100% 'We would be very foolish to develop superintelligence now, when there is no scientific consensus it can be developed safely and controllably

This dismissal of AI skepticism is egregiously wrong, or at least deeply selective, @jeffclune. Was I wrong that pure LLMs would always be vulnerable to hallucinations? Was I wrong that pure LLMs woul

This is actually an example of why Astra is not artificial general intelligence (AGI). I see the same issues with visual perception demos ie using brightly colored simple shaped objects on a simple ba

Banger paper from Google DeepMind. Every AI weather model so far has been trained and initialized on analysis data, which is itself the output of another model. That means the forecast inherits whatev

hmm. can anybody point to a quote where OpenAI publicly advocated neurosymbolic AI? i have seen explicitly positive words about neurosymbolic AI from Google, Amazon, IBM, Anthropic, etc. but am not aw

I read some strange criticisms of this post. So here is my take. I’m not fully endorsing the piece by Newport, but there’s quite some factually true information in it. Responsible and careful people (

OpenAI’s chief scientist: “The idea of racing forward at all costs seems absurd once one internalizes the seriousness of the stakes.” I wrote about the state of AI, why I’m concerned about the next fe

OpenAI’s CISO🤦‍♂️ Well let’s dive into this—shall we Below is a screenshot of Open AI’s Chief Information Security Officer Dane Stuckey who during work hours is on X shit posting under his alt but for

🚨scoop from @theinformation: Anthropic (which has yet to established stable profitability) has committed to $517 billion in compute deals - almost 3x what they had previously told investors. by my est

Listen to my conversation with @GaryMarcus about why he’s stated that OpenAI needs to Pause NOW. Gary’s not ready to pause all frontier AI, but Pause is a solution to many problems, including OpenAI’s

me: AI isn’t that smart & remains unreliable and now I am worried that monitoring-which likely could have prevented multiple incidents-is being reduced, and also worried that OpenAI has consistently n

This is a weird behavior in coding models and something worth looking into. It turns that some models over-edit code that another models wrote. There is a high chance that your repo now has commits fr

100%, which is the core of why I called for a pause on OpenAI in my newsletter today. The Hugging Face incident was probably just the tip of the iceberg. OpenAI has lost control and they're hiding imp

'• And as a scientist, it’s disappointing that we don’t (yet) know much about how the system actually works.' This is so true. Hot take on OpenAI GPT-6 Astra*, with a challenge to @gdb’s claims about

Astra is a genuine improvement but not even off trend. So much for GPT-6 being AGI, folks. (i think we can safely assume that real AGI would be significantly above the trend line,) GPT-6 Astra has set

Crazy to see this. I have spent years saying that GenAI was unreliable and we can’t trust it. The fact that it cannot be trusted to follow instructions is a core part of the issue, as I have been poin

Does Astra have human-like continual learning capability over long periods? If not, it's not AGI. Even a system that could pass @demishassabis's new 'Turing test' where it has to independently discove

Good old days at OpenAI in 2016: an agent stares at screen pixels, moves a mouse, and books a flight on United. We called it World of Bits, inside OpenAI Universe. 10 yrs later, Astra is reincarnated

It's weird thinking back to 6 weeks ago, when I and others thanked OpenAI for disclosing the HF incident, now that we know they were covering up a 2nd incident. Are there more incidents that they know

sounds like the government testing standard fail to adequately factor in monitorability. that’s bad. OpenAI announced its latest model, Astra today. When asked during a briefing if they followed the n

⚠️ This is really scary. Proxies for OpenAI are laying the groundwork for saying the rest of us should suck up rogue AI risk and quit our bitching. Because they know they are on the verge of losing co

Anyone who cared about the science of AI would find this interesting. But if you are just here for the religion, I guess you don’t? 🚨Breaking: The success of GPT-6 Astra on ARC-AGI-3 provides strong e

Brilliant paper on long-horizon agents. They cut 78.9% of an agent's LLM calls while raising its success rate. Here is how: It turns out that ReAct issues one primitive action per model round. That al

No. I still don't think that pure scaling of LLMs can lead to AGI. BUT... ... most recent advancements aren't actually about scaling LLMs. The really about adding deterministic, symbolic stuff to LLMs

'One remaining area of important capability we haven't seen demonstrated yet by any model is open-ended invention and discovery.' Benchmarks keep going up. Open-endedness keeps moving up in importance

there is “no ground-truth information about what is actually happen” because your “Open” company won’t share what it is doing, but yes we need regulation to ensure transparency. on that we agree. this