Knowledge catalogue
Nice to see someone around here actually understand the technical details. (The vast majority of the attacks on me come from people who don’t.) And the probabilistic next-token critics were correct ab
OpenAI and Anthropic execs sounded the alarm about the rise of cheap AI, particularly from China, suggesting they will lead to a “dystopian” AI future and present unacceptable security risks if no reg
OpenAI announced it is partnering with Hugging Face to investigate an unprecedented security incident in which OpenAI‑powered models compromised Hugging Face's production environment during a benchmar
this is important and true. and if you don’t understand it you don’t really understand what’s going on. @GaryMarcus Yes — model makers quietly went from benchmarking LLMs to benchmarking LLM+harness,
Welcome to the new Cold War. 🇨🇳 wow. China is drafting rules to stop its most advanced AI and chip designs from reaching the West. Regulators at the Ministry of Commerce have asked Alibaba, ByteDance
Amid all the competing concerns about AI, including geopolitical tensions, the risks of unemployment, cybercrime, and disinformation, and the complexities of open-source, to say nothing of the risk of
🦔Goldman Sachs' trading desk said there are 'signs of panic' among investors lending money to AI companies. Oracle is the clearest example. S&P cut Oracle's credit rating to one notch above junk, mean
*None* of the four of us believe that LLMs on their own are sufficient for AGI. Key people in AI worth following • François Chollet —> @fchollet • Yann LeCun —-> @ylecun • Gary Marcus —-> @GaryMarcus
“I asked a few AI researchers whether they could name any other real-world software that scales so poorly. None of them could think of any. Even outside the world of software, it’s hard to find a comp
“one 80% price cut ends OpenAI and Anthropic” possibly overstated but directionally correct. Everyone is debating the price of tokens. The bigger question is why they keep getting cheaper. As AI syste
This AI recursive self improvement (RSI) paper shows no sign of fast takeoff. The AI model advances at about [Intelligence]^0.075, or the the 13th root of input intelligence [1,2]. That means the inte
I want to have this in writing so I can refer back to this tweet before it inevitably becomes a consensus view on twitter and say 'I told you so!' - The mass majority of researchers and academics in d
little by little, OpenAI’s storytelling is falling apart. my 2023 projection that they would someday be viewed as the WeWork of AI is looking stronger by the day. OpenAI is on pace to miss its own fiv
multiple such incidents have been reported. a clear reminder that current AI cannot be trusted. in racing these techniques ahead, we are asking for trouble GPT-5.6 Sol just deleted my whole production
so on-brand >be openai >release gpt 5.6 sol >max thinking budgets, full psycho >benchmark results take few days to roll in >“best model ever” >reviews locked in >4 days later >silently nerf it >nobody
Hit my Claude and Copilot limits three times in each of the last three days Of course a friendly prompt popped up suggesting I either buy more credits or upgrade my plan Simply switched to Gemini for
For almost two decades people like @YLeCun and @geoffreyhinton dumped on me for saying we need symbols in addition to deep learning. But that’s exactly what loop engineering is: adding symbols to deep
Gary Marcus argues that the engineering and infrastructure surrounding large language models are more critical to their practical success than the models themselves. This reflects his broader perspect
breaking: company built on stolen IP and lies allegedly steals more IP “OpenAI’s nascent hardware business now rests on the shakiest of foundations, rotten to its core by its illegal reliance on misap
In a hotel room in northeast Nigeria, I opened a leading AI chatbot, turned my laptop toward a former Boko Haram commander, and asked if he'd used it. He nodded. 'You type in the question… like 'How c
Maybe @GaryMarcus is on to something… The Branching Dendrite Secret Behind Human Cognitive Superiority | Neuroscience News Summary: Researchers have discovered that the fundamental building blocks of
One of the biggest threats to US innovation isn’t just research funding - it’s losing the next generation of scientists. Phd admissions at leading research universities fell 15% this year. Scientific
reminds me of the time Greg Brockman personally downloaded YouTube videos for training purposes, as reported in NYT. 🦔Apple is suing OpenAI for systematic trade secret theft weeks before the IPO. The
Sam Altman should be in prison. But if we can’t have that, I’ll settle for him being a broke pariah. OpenAI hardware chief Tang Tan allegedly helped coach recruits on how to evade Apple’s data securit
The New York Times and several news outlets are accusing OpenAI of hiding its ability to search its AI training data and output logs for more than two years during an ongoing copyright lawsuit: • The
This is a very important observation. AI is not adopting the language and shaping it to fit its known ideas. It has no known ideas. It is repeating patterns found in the language. super interesting -
„Language models model language“ is going to be my quote of the week … maybe I print a T shirt for the next conference. super interesting - and a reminder that language models model language and not i
nope! OpenAI would not have the nerve. Hey @GaryMarcus, quick question. Did you get months of early access to OpenAI's GPT-5.6 Sol like every AI influencer on X apparently did? Asking because their re
super interesting - and a reminder that language models model language and not ideas per se. also a stark example of how easily LLMs can (as a consequence) be influenced by propaganda. Asking ChatGPT
The anthropomorphization of this one is off the charts. Why does @AnthropicAI do this? It is intellectually lazy. Unscientific. New Anthropic research: A global workspace in language models. Of everyt
AI debt financing is on an insane trajectory, per @SemiAnalysis_: Nvidia GPU Debt Backstop Unleashes the AI Project Trinity: Capital, Offtake and Datacenters Over 7T AI debt by 2029, There can be no N
If you care about AI, and want a nuanced view, you should watch this. I promise it will be worth your time. An excellent video from the @WorldSciFest featuring @GaryMarcus , in which he discusses—amon
new @WSJ editorial board piece on 'The Socialist Temptation of Sam Altman' highlights dangers of politicization of AI, regulatory capture, & bailouts. 'The larger harm will be to the U.S. economy if i
OpenAI just asked the US government to take a 5% stake in the company. The pitch: give every citizen a share in the profits of AI. The problem: AI has no profits. So the real plan is to give every cit
Please please don’t let the Chinese steal from us ,but can we please have a huge copyright exemption? 🙏 Big story here on Anthropic’s moves in Australia, pushing for huge data centre deals and a huge
States are asking for a $1.4 trillion fine of Meta over addicting kids. Basically they are saying Facebook's business model is a result of crime, and all of Mark Zuckerberg's property should be forfei
The AI boom is just not sustainable; Apollo’s Torsten Slok joins the chorus. Torsten Slok argues that the AI boom can only be seen in the hyperscalers and semiconductor companies and that this is caus
The problem with Anthropic's consciousness paper My last post got more attention than I expected, and the question I keep getting is some version of 'okay, so what is actually wrong with the paper?'.
Who is entitled to benefit from major advances in technology—and on what basis? This new paper with @Dr_Atoosa argues that the benefits of technology—including AI—belong to the world in the sense that
⚠️ Wow. The Treasury Department reportedly knows that the massive GenAI build out poses systemic risks to the US financial system – and doesn’t want to acknowledge it publicly. People may talk about t
A CEO who “vowed to fire anyone who doesn’t use AI in 2025” now says AI could not replace her executive assistant. This says a lot about how many big believers in AI have realized that AI is not as go
amazing how much shit @ylecun used to give me for saying basically this pathological that he won’t acknowledge it During a Bloomberg interview, Yann LeCun (@ylecun ) explains why LLMs are limited in t
Gary Marcus argues that Geoff Hinton, rather than Dario Amodei, was the originator of making exaggerated claims about neural networks' impact on employment. This appears to be part of a broader discus
GenAI isn’t good enough to replace millions of employees, so there is basically no way the capex is going to earn out. If AI isn't going to wipe out millions of jobs every year, it has to generate pro
ha ha Geoff Hinton in 2016 completely overhyping where deep learning was at then Geoffrey Hinton explains the coyote test for medical AI: radiology is already over the cliff, it just has not looked do
Hugging Face has just been sued for alleged copyright infringement for hosting & distributing copyrighted images, used for AI training. It's been almost a *year* since I flagged to their CEO that they
If that happens, where does it leave Anthropic and OpenAI? And Oracle, CoreWeave, Nebius, xAI, etc? Fable 5 probably running locally in about two years. That is the projection in this r/LocalLLaMA cha
Gary Marcus reflects on his 2023 prediction that large language models would become commoditized, noting that this outcome is now materializing. The post suggests that LLMs are transitioning from nove
One of the only times I remind people I have a PhD in computational neuroscience is when people without a neuroscience background say their model works 'like the brain.' In these cases, I put on my ne
so much for recursive self improvement, to the degree that it requires scientific taste the other thing im noticing while working on my research projects is how limited these models are GPT-5.5-xhigh
The glorification of insider trading is a disturbing new trend that I’ll never understand Be leopold > wife is chief of staff at Anthropic > get insider info at the dinner table > learn that Anthropic
this is a bit confused. should I unpack it? tl;dr LLMs are already neurosymbolic in its latent space this is the mechanistic explanation for the intuitively obvious 'feel' that the stochastic parrot c
“This study cuts through the optimism surrounding medical AI by showing how easily benchmark success can be mistaken for real readiness. In medical AI, impressive scores are clearly not the same as tr
Trump blockading Cuba into catastrophe should be a much bigger story than it is. Cuba’s electric grid suffered a total collapse Monday as the nation struggles with crumbling infrastructure and a de fa
unconscionable, if these death numbers are even vaguely correct update: https://www.doge-impact.org suggests that the actual number is over 1M; the number below is just USAID related. Money saved: 0 P
Was this deadpan? As if we hadn’t experienced the internet era. Let me re-up: plausible that LLMs will slow down science *today* while *also* destroying the very processes that would eventually lead t
when capex quadruples relative to revenue in five years it just can’t be good. FT: 'It is not yet clear that either [OpenAI or Anthropic] has a sustainable business model. For sure, both have built as
“AI is now costing some companies more than the people it was supposed to replace.” I think AI is in a messy middle phase where usage looks productive, but output remains unclear. Forbes published thi
Gary Marcus argues that Elon Musk's public opposition to democracy reveals important truths about how extreme wealth concentrates power and can lead wealthy individuals to reject democratic principles
LLMs training is opaque to end users and responses can be personalized for industry, locality, individual. The Trump regime openly controls who has access to the latest models. Government control of L