All entries

FrontierCode has three task sets: Extended (150 tasks), Main (100 tasks) and Diamond (50 tasks). SOTA LLMs have significant room for improvement, with the top model earning a score of just 13.4/100 on

further evidence that people shoveling money into AI are either bad at math or blind to risk Striking paper from Wharton. The big conclusion: AI must increase productivity 2.7x -- and quickly -- or te

This post discusses the statistical probability of a candidate receiving 30% of the general vote but zero votes in a late-night ballot count, likely raising questions about voting irregularities or da

Gary Marcus argues that large language models based on transformers quickly reach their limitations, prompting developers to add external tools as workarounds, while neurosymbolic AI—which combines ne

Clem Delangue discusses using local AI models and LlamaCPP to prepare for a flight to NYC without internet access, highlighting the utility of offline AI tools for travel preparation. The post demonst

Good take My guess is - demand for intelligence is near infinite - but 80% of workloads will be running on 99% cheaper models within 12-18 months - 20% of workloads will still run on latest gen models

This paper from researchers at Hazy Research (Jon Saad-Falcon and Avanika Narayan) appears to present novel research findings, likely related to machine learning, language models, or AI systems given

Great tips. In practice, this is how it roughly looks to run agents autonomously for hours or days. /goal or /loop to keep it going. Verification is crucial here. Seeing a number of benchmarks showing

Great to see AI maturing and finally adopting what we've been preaching for a while now: multi-model workloads! It will go even further progressively though with most companies not only using dozens o

Grok Imagine Video 1.5 Preview has officially taken the #1 spot in Image-to-Video generation on Design Arena • #1 overall with a 1357 Elo rating • Massive 49-point lead over the next-best model • Ahea

This post likely explains the concept of loops in programming or automation workflows, covering how they function and their practical applications for automating repetitive tasks. It probably includes

Historic: when the President of the United States can’t provide a single bit of specific concrete evidence to back up his serious charges, and has a temper tantrum when pressed. Trump has a meltdown a

🚨 HOLY SMOKES. Governor candidate Steve Hilton just revealed the stunning reality of California fraud: They ALLOW mail-in ballots to BACKDATE by HAND so they can be counted late, and not invalid 'It's

Bentley Labs uses Runway's AI video generation tools to create visual content for storytelling about critical infrastructure projects, demonstrating practical applications of generative AI in document

Hypers got hype but this is an embarrassingly bad piece of analysis that sets up a false dichotomy and ignores the fact that Terence Tao also signed the Leiden Declaration. 🤦‍♂️ This post is unavailab

Gary Marcus, a prominent AI researcher and critic, is considering writing a book titled 'Seven Lies About AI' that would debunk common misconceptions about artificial intelligence, with a planned sequ

i expect value for money to increase over time as competitive pressures force providers to lower prices. but in the short time, looks like the opposite may be happening: Does a token buy you more or l

🤣 I have to think that anyone who buys the SpaceX IPO just isn’t that good at math. Or history. “Garnering that almost 600x increase means hiking sales 50% a year, on average, for a decade.” 👇🏼 https:

Nous Research has released a feature or tool that allows users to display their AI agents in small, compact window sizes, improving UI flexibility and workspace management. This update addresses user

I really do think we'll see a lot of value accrue in AI startups building 'model routing as a service' Not just OpenRouter - this includes a much broader set of verticalized agents and infrastructure.

I will start to take Geoff Hinton seriously again (I used to and don’t anymore) when - radiologists actually start losing jobs - he acknowledges that LLMs do sometimes effectively memorize things - he

I would trust @eastdakota over Vinod Khosla any day of the week; it’s not even close. One is a man of integrity, with compassion for other human beings; the other isn’t. Uhhh… your memory is failing,

I wrote my first neural networks in pure C, then in Matlab, then in NumPy, before eventually upgrading to Theano. Since then I have seen and tried pretty much every NN framework ever developed. Some a

This post argues for passage of the SAVE America Act before November 2026, citing lessons from California elections as justification. The specific policy details and Musk's particular concerns are not

I'll never forget @GaryMarcus' comment at last autumn's @MediaTechDem conference in MTL - something to the effect of 'what if Nvidia are just the people who sold shovels in the gold rush'? Striking pa

Imagine the Sun is a giant never-ending battery. Right now on Earth we only sip a tiny tiny bit of its power. SpaceX wants to send big smart computer brains into space on their huge reusable rocket (S

in hindsight, this was chump change New: Microsoft and OpenAI plotting new 'Stargate' supercomputer that could cost $100 billion. An incredible look at what it will take to build the next generation o

Interesting model here 35b a3b trained for agentic use It gets 60.7 on Terminal Bench2 qwen 3.6 27b gets 59.3 Essentially the same Going to have to try it out https://huggingface.co/nex-agi/Nex-N2-min

interesting recursive loop here maybe I have a new kind of big button that I can press for Codex. Over the next 100 days, we will select one person per day who does impressive or incredibly useful wor

Introducing FrontierCode: a coding eval that raises the bar for difficulty & quality. Each task took 40+ hrs of work by leading open-source maintainers. Models write sloppy code that works but isn’t m

Introducing 'Signals of AI' - DeepAgent powered by - @nebiustf for Inference - @NVIDIAAI Nemotron 3 Ultra - @tavilyai for Web Search - @LangChain for the core deepagent architecture! An ideal engine f

It's a big AI day for Apple at WWDC26! A few humble name proposals for the new overhaul: - Apple Intelligence 2: Siri’s Revenge - Apple Intelligence: 2 Fast 2 Furious - Apple Intelligence II (ft. Gemi

It's finally out!!! @METR_Evals found that more than half of SWEBench results is unmergeable slop. FrontierCode represents over 1000+ hours of maintainer validated software engineering work most front

Argentine President Javier Milei praised Elon Musk as a 'hero in the history of humanity' for his efforts to counter what Milei characterized as the 'woke mind virus.' The statement reflects Milei's a

✅ July 2024: “public sentiment towards AI will turn sharply negative. In the end, AI leaders will be viewed like cigarette industry leaders.” Prediction: @a16z’s meddling will backfire massively. US w

Kimi Code, our open-source coding agent, just got a major upgrade! 🔹One-line CLI install, zero setup, fast startup​ 🔹Drag in videos as coding context: reference-to-LUT, long-video-to-short, screen-rec

🇰🇷🇰🇷 Korea is Awesome 🇰🇷🇰🇷 For the first time ever, an imported vehicle became the best-selling car in South Korea and it’s the Tesla Model Y Not just the best-selling EV The best-selling vehicle over

LangSmith Fleet introduces file handling capabilities that enable users to create and manipulate documents, presentations, and webpages directly within conversations, as well as upload existing files

Last time around Apple released a lot of information about how their AI version of Siri worked between local and cloud models, not so much this time It is nice to have a Gemma-like model on device, bu

Let's recap the weekend: -Billy Schmidt (a 22-year-old Penn State student) was murdered by two black men over a phone in South Philadelphia. -Louis Erebia (a 56-year-old father of 5) was murdered by a

many young researchers think it might be good wipe out humanity. terrifying article. who are ceding control of our planet to? Part 1 of my 'Pro-Human Manifesto' is now out! I'd love to know what you t

Meet Kimi Work - a local AI agent on your desktop that does the work for you. 🔹Native agent swarm: Up to 300 AI agents running in parallel on your local machine. 🔹Browser use: Paired with WebBridge ex

@METR_Evals previously on @cognition_labs https://x.com/swyx/status/2062611218196771017?s=20 Finally! the first eval ship from cog!!!!!!!!!! 👼🏼 To contextualize: @METR_Evals cap out at ~16 hours. Cog

Model routing is growing a lot these days Good take My guess is - demand for intelligence is near infinite - but 80% of workloads will be running on 99% cheaper models within 12-18 months - 20% of wor

More people need to listen to what Gary is saying here. Many, MANY of these talking heads who suck the oxygen out of the room with just their ego, say things that are so wildly wrong, that its misguid

My own personal experience w Khosla is described here: The legendary investor Vinod Khosla is in the news because of questions about his integrity. I want to share my own experience: he lied viciously