Search: “ethan-mollick”

I keep coming back to this tweet. The phrase “the list” is doing the heavy lifting. The post deserves the weight. It is a load bearing post. You should add the phrase “doing real work” to the list of

Ethan Mollick cautions against using an unspecified resource (likely an AI tool or educational material) for high school physics instruction without thorough verification, noting he only conducted cur

I realize that “Mythos as hype” means two different things to different groups. For insiders, it means “Mythos was not a magical step-change in AI ability.” For outsiders, it means “Mythos couldn’t re

Professions with guilds or membership associations are going to get different AI policy reactions than those without The Bar & the AMA will ensure that human doctors or lawyers are legally required fo

Unions often push back against automation, often successfully (see self-driving car fights). But just wait until you see what happens when highly connected, wealthy, and organized white collar workers

Very good hire by DeepMind. Some news: This week I am starting at @GoogleDeepMind as Director of AGI Economics on @shanelegg’s team. I will be joining the other amazing cross-disciplinary scientists r

Don’t let the exponential gains in ability fool you: there are fewer real grand plans in AI (or frankly any field of human endeavor) than you think. Companies are pivoting as the market changes, somet

Every so often I think about how, in 2022, for $24B we could had 'prototype vaccines ready for each of the 26 known viral families that cause human disease' so they can be deployed in 100 days if ther

This post likely features Grok (Elon Musk's AI chatbot) being used to explain complex concepts or vocabulary terms in simplified language for readers who prefer not to independently research definitio

If Llama 4 didn’t fail, if Microsoft had pulled Sydney after the Roose article, if New Sonnet hadn’t been so good, if Orion hadn’t been so meh, if the leadership change at OpenAI had happened, if a re

Ethan Mollick asked Grok (xAI's AI assistant) to explain various cultural, historical, or technical references, likely exploring Grok's knowledge comprehension and ability to contextualize diverse top

It is remarkable how quickly this market shook out. Anthropic & OpenAI are in business take-off, at least: they have the model development, enterprise deals, compute deals, government & press attentio

Labs; “we will have a nation of geniuses in a data center by 2028, capable of beating humans at every task, but you will need to hire our newly trained forward-deployed engineers for a six month engag

OpenAI for Excel is quite useful (as is Claude for Excel), so it is surprising, that, unlike Claude, there is no OpenAI for PowerPoint, especially because it is where OpenAI has a big advantage: Image

Pareidolia, but for text. Apophenia, but for latent spaces. Its no wonder that our relationship to LLMs is so confusing. It's hard enough to resist apophenia in normal life, in such high dimensional l

Seems like a massively underinvested area in the “pivot to enterprise.” The fact that the Labs are building their own deployment consultancies (which will take a long time) suggests a failure of imagi

“She said the theme of this party is the industrial age. And you came in dressed like a train wreck.” Asking AIs to think of the equivalent to this Hold Steady lyric, but for AI. Claude was the clear

So Mythos was, indeed, not marketing hype. Remember this is a general purpose model that just happens to be good at finding exploits because good models are good at lots of things. Expect similar from

The inability of AI systems to act as their own deployment consultants, process mappers, and change management experts is what makes AI use in enterprises so “normal” - the tools are powerful, but you

A critical question in agent design is “how do we build agentic workflows so humans are given significant, interesting, or variance-producing decisions as they come up in the work?” A Claude-run compa

Sustainable competitive advantage in AI implementation comes from redesigning workflows to strategically integrate human expertise rather than pursuing full automation, as human-AI collaboration creat

I usually avoid commenting too much on industry deals, but this one is fascinating. Certainly seems like a blow to the idea that Grok will remain a frontier model. Our agreement with @SpaceX means we

A reminder that telling the AI that it is an expert in a field is no longer helpful in making the AI better at that field. We tested one of the most common prompting techniques: giving the AI a person

All benchmarks are flawed, but GPQA has been fairly consistent & highly correlated with other measured benchmars. I think it's a good way to see how far we've come that the free model from OpenAI, GPT

Also Instead of the gold standard, we can imagine an inference standard of exchange, the FLOP. (As opposed to tokens, this accounts for AI ability) With some AI help, I figure 1 buys roughly 10^17 man

Mollick argues that AI policy and development will inevitably remain contested territory because different stakeholders—including governments, corporations, researchers, and the public—have fundamenta

For individual AI use, the jagged frontier is increasingly well understood. In multi-agent workflows in organizations, AI is jagged in ways that have not been well identified yet. In fact, we don't ev

In addition to the CAISI evaluation, it would be useful if NIST conducted public tests of AI abilities as an independent evaluator - though those obviously should not be pre-release tests & can be don

Ethan Mollick advocates for dedicated funding toward developing independent benchmarking systems for AI models, noting that evaluation is currently predominantly conducted by the labs that create the

Missing from the “will AI replace doctors?” debate is that doctors (and lawyers and psychologists and bankers) all vote & form the donor base to political parties & have deep community ties. The gover

Ethan Mollick suggests that Mythos, likely an AI model or system, demonstrates strong capability in identifying and diagnosing pig diseases, possibly indicating its effectiveness in agricultural or ve

FLOPs (floating-point operations) serve as a practical metric for measuring AI computational capacity because they have a precise technical definition, can be directly priced and measured, and offer a

The unreasonable effectiveness of LLMs is what makes them so weird. The labs don’t need to decide what kind of AI to build, because better LLMs do better at most things. Finance? Pig disease identific

Too much of the solutions & language for agentic systems comes from a coding perspective (control planes, hooks, loops), but I really think that the field of management and organizations can tell us m

We know the answer: Cal State LA, followed by Pace & SUNY. State systems in California, Texas & New York are great for moving many born in the lower 20% of income to the top 20%; Ivies for moving a fe

A challenge with AI regulation and vetting is how bad our benchmarks of AI model performance and risks are. There is no benchmark for risks and red-teaming requires experiments from dedicated speciali

Co-founder of Anthropic, interesting that he refers to public sources when he is also obviously privy to lots of internal sources that he cannot discuss. I assume he sees the same thing at Anthropic.

I think the fact that GPT-4o and Llama 3.3-80B did no significant harm is just as important as whether AI helped. If older (less accurate & more sycophantic) chatbots essentially did nothing for peopl

It is somewhat comforting that now, whenever I see a post about “here’s the thing that keeps me up at night” I know that there is absolutely no chance that this is being written by a human who is stay

I cannot provide a summary for this entry as the post content appears incomplete or corrupted in the provided information. The title is cut off mid-sentence and doesn't clearly convey the full topic.

My surprise here seems warranted, this paper was retracted (There are other peer-reviewed meta-analyses of the impact of AI on education finding positive effects, like: https://www.researchgate.net/pu

Poems that ChatGPT, Claude, and Gemini all seem to 'like' when you ask for poetry related to being/making LLMs: Rilke's 'Archaic Torso of Apollo' Stevens' 'Idea of Order at Key West' Borges's 'The Gol

That doesn't mean that there should not be regulation and vetting, but it does suggest that is hard to write a criteria right now that is not somewhat vague. More R&D into non-lab benchmarks is urgent

This is a very niche post, but they are good poems. I hadn't read Autopsychography until it came up from both Claude and Gemini. And if you haven't read Rilke, that poem, with its incredible end, is a

I am not sure I would agree with all of this, but the relationship between Anthropic and Claude is quite different than the relationship between other labs and their models. And that shows up in lots

Its getting hard to benchmark frontier agent performance on longer tasks. Repeated measurement is very expensive and there are differences between using models in harnesses versus via APIs. I suspect