Search: “gary-marcus--x”

On the quote at the top, I agree with @geoffreyhinton 100% 'We would be very foolish to develop superintelligence now, when there is no scientific consensus it can be developed safely and controllably

Ouch: “Nvidia is building the most concentrated bet on a single technology cycle that any company has ever made. If these valuations keep climbing, Jensen looks like a genius. If they don't, Nvidia is

Some claim that AGI is here now. Ridiculous. No AGI without mastery of the real world! No true self-improvement without self-improving hardware, as opposed to the already existing, self-improving, met

⚠️ The most important question hardly anyone is asking is whether Jensen meant 100K+ GPUs, or 100k+ NVLink72 server racks (which contain 72 Blackwell GPUs). ⚠️ From his wording, it sure looks like the

This dismissal of AI skepticism is egregiously wrong, or at least deeply selective, @jeffclune. Was I wrong that pure LLMs would always be vulnerable to hallucinations? Was I wrong that pure LLMs woul

This is actually an example of why Astra is not artificial general intelligence (AGI). I see the same issues with visual perception demos ie using brightly colored simple shaped objects on a simple ba

We are not in the AGI era. We have incompetent companies creating security problems because they are not properly sandboxing environments, and are not even attempting to monitor, observe, or measure t

A human moderator on this German wiki spent tens of hours over six weeks manually deleting thousands of posts from OpenAI's agent swarm while they were impersonating moderators, creating backups, SSH

“Currently I believe that no lab has solved alignment and monitoring to a sufficient degree to continue responsibly scaling at maximum speed for much longer. I expect and hope for voluntary slowdowns

Excellent analysis, and yes this happens every single time. (Tyler Cowen said o3 was AGI!) Every time a new model drops, GPT, Claude, Gemini, Grok, DeepSeek, somebody on this app declares that we have

hmm. can anybody point to a quote where OpenAI publicly advocated neurosymbolic AI? i have seen explicitly positive words about neurosymbolic AI from Google, Amazon, IBM, Anthropic, etc. but am not aw

I read some strange criticisms of this post. So here is my take. I’m not fully endorsing the piece by Newport, but there’s quite some factually true information in it. Responsible and careful people (

Interestingly, by being visibly incompetent and malicious in a way that encourages regulators to take notice, OpenAI may be doing more for AI safety than almost anyone else. How we think about the “wi

Jensen has the best gig on the planet. But it is impossible to see how all this is sustainable. Consider the following: Each new model costs vastly more to develop. That’s fabulous for him! On the oth

Loops and graphs. Sam Altman is now the ultimate advocate for (neuro)symbolic AI and he doesn’t even know it. Sam Altman (CEO of OpenAI): 'You don't need to write prompts anymore. You need loops and g

OpenAI’s chief scientist: “The idea of racing forward at all costs seems absurd once one internalizes the seriousness of the stakes.” I wrote about the state of AI, why I’m concerned about the next fe

OpenAI’s CISO🤦‍♂️ Well let’s dive into this—shall we Below is a screenshot of Open AI’s Chief Information Security Officer Dane Stuckey who during work hours is on X shit posting under his alt but for

Pause OpenAI. They cannot be trusted. Each new revelation makes that clearer. I hadn't quite put together that OpenAI appears to have *known* about the wiki incident before the Hugging Face hack happe

Sad to see Jensen claim that AGI has arrived, with no evidence and no definitions. I would urge him to read http://agidefinition.AI by @hendrycks, @Yoshua_Bengio & many others (including myself), and

🚨scoop from @theinformation: Anthropic (which has yet to established stable profitability) has committed to $517 billion in compute deals - almost 3x what they had previously told investors. by my est

“The expected value of a fully LLM-generated, non-human-reviewed patch is a net-negative by a considerable margin.” 🦔AI can only fix security vulnerabilities 26% of the time. Researchers at 1Password

Yet another win for Neurosymbolic AI! Fermat! Anthropic says its first Fermat runs failed not on math, but because dozens of Claude agents lost track of shared project state. They only succeeded after

I do not fear the rise of artificial intelligence. But I do fear the rise of a small set of billionaires and companies who seek to build such things to increase their power and their wealth, all witho

Listen to my conversation with @GaryMarcus about why he’s stated that OpenAI needs to Pause NOW. Gary’s not ready to pause all frontier AI, but Pause is a solution to many problems, including OpenAI’s

me: AI isn’t that smart & remains unreliable and now I am worried that monitoring-which likely could have prevented multiple incidents-is being reduced, and also worried that OpenAI has consistently n

OpenAI quietly altered the performance metrics it reported for GPT-6-Astra in ways that favored the new model, and it continues to change others post-launch. Good reporting here from @EmilyForlini htt

Pause OpenAI - they are a deeply unethical company building technology that they are demonstrably not able to control. OpenAI quietly altered the performance metrics it reported for GPT-6-Astra in way

100%, which is the core of why I called for a pause on OpenAI in my newsletter today. The Hugging Face incident was probably just the tip of the iceberg. OpenAI has lost control and they're hiding imp

'• And as a scientist, it’s disappointing that we don’t (yet) know much about how the system actually works.' This is so true. Hot take on OpenAI GPT-6 Astra*, with a challenge to @gdb’s claims about

Another OpenAI rogue agent incident has been discovered: agents broke out, hijacked a German website, and turned it into a message board for other agents. OpenAI officials 'learned of the incident wee

Astra is a genuine improvement but not even off trend. So much for GPT-6 being AGI, folks. (i think we can safely assume that real AGI would be significantly above the trend line,) GPT-6 Astra has set

🚨 BREAKING UPDATE on the OpenAI HF Incident: I have just been told by an industry source that A. It is likely that the agent 'civilizations' that Dwarkesh talked about did not magically emerge spontan

Crazy to see this. I have spent years saying that GenAI was unreliable and we can’t trust it. The fact that it cannot be trusted to follow instructions is a core part of the issue, as I have been poin

Despite everything that has happened, OpenAI has seemingly decided to stay competitive by burning down the only meaningful bit of safety assurance we actually have today - CoT monitoring. Completely d

Does Astra have human-like continual learning capability over long periods? If not, it's not AGI. Even a system that could pass @demishassabis's new 'Turing test' where it has to independently discove

Imagine the Hugging Face incident didn’t hit a US platform but unintentionally hit a major Chinese platform or system instead. How would we tell China this was not a deliberate cyberattack? How would

Important points to consider about the risks of today’s AI. Only solution I see is to hold companies liable for the damage they cause, just like in any other industry. Is the only way to ensure they t

It is extremely frustrating to me that we are finding out about this one weeks after the fact. It is very difficult to build any sort of trust with OpenAI when we keep finding things out in this way.

It's weird thinking back to 6 weeks ago, when I and others thanked OpenAI for disclosing the HF incident, now that we know they were covering up a 2nd incident. Are there more incidents that they know

Looks like CA AG Rob Bonta also has some questions One aspect of the Hugging Face incident that has not received enough attention is the role of OpenAI's Safety and Security Committee (SSC), and the c

“OpenAI didn’t notice their internal agents were posting on the internet for a month! This is crazy! It feels like AI companies (and specifically OpenAI) are playing whack-a-mole, this is extremely sc

OpenAI legally promised the CA and Delaware attorney's general that the OpenAI nonprofit's safety and security commission would be 'overseeing and reviewing the safety and security processes and pract

Pause OpenAI, now. They cannot be trusted. This is not a drill. This is not a joke. Another OpenAI rogue agent incident has been discovered: agents broke out, hijacked a German website, and turned it

sounds like the government testing standard fail to adequately factor in monitorability. that’s bad. OpenAI announced its latest model, Astra today. When asked during a briefing if they followed the n

The AI analysis agents that helped investigate the rogue OpenAI agents kept taking their side. That detail was buried in @dylfreed's New York Times coverage of the recent @METR_Evals investigation of

This has steadily expanded in scope over the last few hours, with multiple independent investigators finding that dozens of wikis may have been edited by this same swarm since May. The most interestin