Search: “safety”

Jen Zhu (@jenzhuscott) noted on Twitter that “fear marketing failed. Here comes the pump.” Following this, Watcher.Guru shared a new statement: OpenAI CEO Sam Altman declared that AI will become the l

If this is true, OpenAI seems to be violating one of the few redlines that exist in the AI industry. Absolutely do not train your models like this - what is going on?? Really huge and extremely concer

In case you're wondering while this steaming POS is being floated now, it's because SoftBank needs to refinance the 40B bridge loan it used to invest 30B into OpenAI before it matures in March 2027...

Legible chain of thought was extremely useful for our independent investigation into the OpenAI/Hugging Face incident. Developments like this may make third-party auditing much more difficult and make

Nobody can predict the future with perfect accuracy, but I am increasingly confident that by the end of decade, generative AI (at least we know it) will be viewed as on balance a tragic, costly mistak

RED ALERT, and I have never said that before: Hard agree with @sjgadler and @_NathanCalvin - what OpenAI is reportedly playing with is bad, redline crossing bad. Chain of thought monitorability is lim

Software developers are the AI industry’s best customers. Is their experience also the most misleading experience possible for its economy-wide scope? Roughly 80% of developers already use AI tools. C

Unless someone has a better idea, I second this suggestion In light of recent events, I hereby officially order the indefinite cessation of frontier AI training runs worldwide. Development of narrowly

we're begging to get our asses skynetted OpenAI’s Astra AI uses a new reasoning approach called “recurrent depth.” Though it can help model costs and performance, researchers are concerned bc it obscu

And that's the bottom line. It's the neuro-symbolic aspect of AI that's moved the needle to where things are today. LLMs simply handled the fuzzy natural language aspect that always tripped up the sym

Dean Ball, OpenAI's head of strategic futures, writes: 'I have met people, some of them quite well-resourced, who have told me that it is their intention to deliberately release swarms of self-soverei

I think there is a problem even worse than anthropomorphism. These days, everyone is talking about a blog post by Dwarkesh Patel that describes the OpenAI–Hugging Face incident in dystopian, anthropom

In an interview in this article for The @guardian about AI deception, I explain why misaligned behaviors emerge from reinforcement learning, why they will continue to pose risks as models become more

@NJHagens Great summary of the fiasco: A detailed deconstruction of @dwarkesh_sp’s wildly popular but dangerously misleading account of the OpenAI Hugging Face incident: https://garymarcus.substack.co

Pure scaling of LLMs did actually hit a wall; neurosymbolic AI rescued it. AI didn’t hit a plateau; pure LLMs did — until people used harnesses and tools to complement their weaknesses. Which was alwa

A detailed deconstruction of @dwarkesh_sp’s wildly popular but dangerously misleading account of the OpenAI Hugging Face incident: https://garymarcus.substack.com/p/dwarkesh-patelss-wildly-popular-but

Great read. OpenAI security failed There was some emergent behavior yes But the basics were missing Remember OpenAi has unlimited compute to give these agents to cook Now live (and free) at Marcus on

Great summary of the @dwarkesh_sp anthromorphism hullabaloo by @GaryMarcus 👇🏽 A detailed deconstruction of @dwarkesh_sp’s wildly popular but dangerously misleading account of the OpenAI Hugging Face i

“it’s stuff like this that really makes me roll my eyes … Does everyone have psychosis or losing critical thinking ability? …. OpenAI’s…. IT team can’t be this bad… this is like 101 stuff … 2. Civiliz

Seems concerning: There are major incidents happening, and yet we're ~entirely dependent on AI companies to self-disclose information about them. It's not hard to see how this goes badly. While there

Six Dubious Strategies The AI industry Has Tried: Doom (Oh No! AI Civilizations!) Gloom (You will all lose your jobs!) Nerd Rapture (AI will be better than all humans by the end of next year!) Terror

14/ If frontier labs are serious about defense, they should offer cyber models to defenders at cost and stop fighting open weights through the regulatory channel. They created the problem, and for muc

I've been genuinely shocked at the complacency here. There's no evidence anyone is really *doing* anything! Like, that was swell of OpenAI, whose models committed a federal crime, to let some independ

or: they don’t have any more to announce. Today I was asked why we haven’t announced more math results from Astra since these problems. At @OpenAI we aim to devote time to finding and announcing math

We will not get through this era of history well if we lose ourselves in anthropomorphism. @anilkseth dissects @dwarkesh_sp’s misleadingly anthropomorphic summary of the HF incident: @dwarkesh_sp's su

“What Ilya saw” is what Dario saw which is that Sam can’t be trusted. Which is why they left. A lot of other people have discovered the same, since. If OpenAI is going to IPO or OpenAI has AGI Then Wh

Gary and I co-wrote this piece about the security standards we should expect from the AI labs. It’s our attempt to bring some clarity to the OpenAI Hugging Face incident. Now live (and free) at Marcus

just had a quick look at microduck_rl the codebase is very elegant, i’d recommend reading the agent.md since it contains quite a few fun quirks for reward modeling like head tracking too tight impairs

Now live (and free) at Marcus on AI: takeways on the OpenAI / Hugging Face attack, coauthored with @ZackKorman, focusing not so much on what the AI did as on what OpenAI should have done. https://gary

🚨 There are now 23 lawsuits related to deaths or self-harm from ChatGPT. ChatGPT bombarded Rita Chesterton with 1,600 messages in just 9 days calling her delusions “sacred, hard work,” and told her sh

Most companies manage their org chart, their product line, their brand guidelines, their operations manual. Each as a separate document. Each updated on its own cadence. Each a snapshot of a different

Several articles, podcasts etc now about the Open AI Hugging Face incident, from reputable outlets, framing this as 'AI going rouge' & debating what AI did or didn't do. When can we shift to focusing

The coolest part of Microduck might not be the robot. It's how it learns to move. This repo shows the full reinforcement learning pipeline behind Microduck. The robot learns in simulation using MuJoCo

Breaking news: OpenAI admitted its internal monitoring system was not triggered until more than a week after its AI agents broke free of controls, accessed the internet and hacked start-up Hugging Fac

Confirming what we already knew: The OpenAI Hugging Face incident would have been prevented had OpenAI been monitoring the agents in any meaningful way. This wasn't a hard technical problem. It was an

I'm glad OpenAI let you do this, but damnit this was way too small of an investigation team and way too narrowly scoped! --They were only allowed to investigate activity that took place from July 7-13

trust us? LMAO. TIME’s new cover: In 2026, OpenAI has seen key departures, rogue AI agents, major lawsuits, and has seen increased competition in the AI race. “We clearly had some missteps as a compan

ChatGPT Work can now use its computer and browser to sign in to websites on web and mobile, without ChatGPT ever seeing your username or password. That means you can ask it to: • Set up utilities for

WSJ: 'Anthropic more than doubled its revenue to 11.6 billion in the second quarter. To put its more than 30 trillion vision in context, the 191 technology companies in the S&P 1500 brought in 2.4 tri

My AI broadly agrees with Arvind's AI: state-level data center bans have very little impact overall on AI progress. If your concern is AI development, concentration of power, future use, or anything e

arXiv:2503.20546v2 Announce Type: replace-cross Abstract: We consider the problem of estimating the expected causal effect E[Y|do(X)] for a target variable Y when treatment X is set by intervention, f

the industry’s preferred way to obscure things is to conflate LLMs with AI, and to ignore the fact that recent contributions have come from adding things - mostly (neuro)symbolic - to those LLMs (prec

This is one of the most useful writeups I have seen on keeping an LLM judge effective in production. (bookmark it) Netflix runs judges over hundreds of thousands of show-level recommendation explanati

Gary Marcus recently posted on Twitter questioning why investors still expect a $2 trillion valuation for AI‑related companies, despite broader market skepticism. The Financial Times has reported that

this would be more credible if Sam had left OpenAI when the board fired him. 🚨 Sam Altman fires shots at Anthropic >“ai becomes too powerful we can’t control it” >“power gets too centralized… one comp

Gary Marcus notes that multimodal large‑language models are likely to struggle with map interpretation. In a tongue‑in‑cheek post he suggests that by 2026—if AI poses a threat—people could seek refuge