Search: “research”

LLM next-token prediction is already a probabilistic classifier, so an open LLM can serve a Jev-like interface: discrete options in, fast probabilities out. Our own @ekzhang1 made it better at the job

arXiv:2609.26270v1 Announce Type: cross Abstract: We introduce the category mathbf{SSS} of sample-smooth spaces over a mixed site. The test objects are the products Omega_n := R^n imes Omega of a Cart

Finally, a company brain that actually works! Codos starts with the people doing the work. It interviews employees to find which tasks can be automated, then deploys the automations and keeps learning

One hope for Tinker is that it can handle all the ML infra for posttraining for (approximately) everyone. So, curious, what prevents you from using Tinker for all your posttraining needs? Speed? Cost?

Obama is pretty accurate here tbh You don’t need RSI or AGI for almost everything we need, few shot learners and cron jobs get you even to breakthroughs Most of the dangerous AI breaking onto the inte

Anthropic, an AI safety and research organization, has established a “wet lab” in the Bay Area to enable the Claude language model to perform real‑world biology experiments. The move accompanies effor

From @WSJopinion: The Hugging Face hack wasn’t what it was cracked up to be. Forget the “hive mind” of AI agents “going rogue.” They did what humans programmed them to do, writes Brian Gross. https://

'People built the test, removed restraints, defined the objective, left a route open and decided not to stop what was happening. Calling the result 'rogue AI' does more than sensationalize it. It allo

arXiv:2609.17578v1 Announce Type: cross Abstract: Let a_1,ldots,a_m be distinct elements of a field K, and let Z(X)=prod_{i=1}^m (X-a_i). We study the arithmetic complexity of computing the unique nor

Excited to announce that the Korean translation of 'Deep Learning with Python (3rd Edition)' by @fchollet and @mattdangerw is published! 🚀 Updated for Keras 3, TensorFlow, PyTorch, JAX, and Generative

Today everyone is talking about Recursive Self-Improvement (RSI). In 1987, when compute was 100,000,000 x more expensive, I published the 1st concrete RSI algorithms. Now compute is cheap, and RSI is

The Anthropic grift machine! FED BY FEAR THEATER. Take a moment and sit with @kevinnbass chart here. You do not need to be a forensic accountant to understand this money laundering. If this is not pro

arXiv:2609.13100v1 Announce Type: cross Abstract: When providing forecasted probabilities with a predictive model, the ideal model offers perfect calibration: the true probability of the outcome (i.e.

Banger paper from Meta. This work shows that byte-level models start out behind token models and then pass them as compute grows. They show this for distilled 1B models trained on up to 1 trillion byt

One thing will defeat the AI Doomers easily: Time. Little by little things will change and AI will diffuse into everyday people's lives and they'll realize it wasn't the scary bedtime story Harry Pott

【AIの難問は、生命の難問へ：英国王立協会が紐解く「世界モデル」と知能の未来】 近年のAIの急速な発展により、AGI、すなわち人間並みの知能はすでに実現したという意見も聞かれるようになりました。果たしてそうなのでしょうか。 鍵となるのが「世界モデル（World Model）」の概念です。 世界モデルとは、生き物やAIが外の世界を内部に写し取り、次に何が起きるかを予測して行動するための土台となるもの

I must be among an extremely small group of people (n=1?) that have both 1) trained a frontier LLM and 2) designed and synthesized custom viruses in a lab with my own two hands. And I think that the t

Investors in Anthropic founded Open Philanthropy, the leading org promoting AI Doom They have a stake in regulation on AI that excludes competitors OP is the major funder of Tarbell Tarbell Fellows pe

Looped transformers are a popular architecture topic right now. This new technical report extends the loop across tokens. Recurrent Looped Transformer (RLT) makes the decoder recurrent over every toke

I love this and really hope we can come together as an industry and make it happen. We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan

Fugu Max pushes the Pareto Frontier for price-performance: • 2 input / 6 output per 1M tokens. • Performance within striking distance of elite models at 2x to 6x lower cost. • Best overall score on 6

Sakana AI has released an updated version of its “Fugu” platform that exceeds performance metrics in some areas compared to the GPT‑6 Astra and Fable 5.1 models. The update does not integrate these tw

A person with mid single digit years of industry experience and months at one company and negligible external footprint quits that job voluntarily and ends up on a press tour that would be the envy of

Certain companies train their AIs to plagiarise work by unnamed scholars, extending an AI history permeated by plagiarism and misattributions. It started a long time ago. In the 1900s, the old method

Congratulations to Tristan Buckmaster and Levent Alpöge for developing the AI assisted techniques for solving an important math problem. Congratulations to OpenAI for not letting any good customer tra

Great study on what actually predicts vibe-coding ability. 100 tertiary-level students completed measures of computer-science achievement, domain-general cognitive skills and written-communication pro

Sebastian Raschka’s September 2026 article introduces **GPT‑6 *Astra***, a next‑generation language model that expands upon the Transformer backbone with a novel *looped* architecture—allowing multipl

🤯 For the Navier-Stokes Millennium Prize Problem solution, OpenAI says they used a next-generation model that is significantly more capable than GPT-6 Astra. If GPT-6 Astra is this good already, imagi

This is insane! GPT-6 Astra built this beautiful math animation in one go! (🔉 sound on) 'Jaw-on-the-floor' moment. I've not been able to get anything close to this with previous AI models. True person

Banger paper from Microsoft and Cornell. If you have looked at thinking tokens and decided you cannot afford the context, read this one. (bookmark it) A pause token buys the model extra compute for ea

How we think about the “wiki incident,” where our agents wrote to several internet sites: it’s past time for us to define standards for when and how we share misalignment incidents, not just misalignm

Every answer in Perplexity starts with embedding and ranking models picking the most relevant results for the query. Today we published research on how we built SoTA serving infrastructure behind thos

GPT-6 Astra by @OpenAI achieves SOTA on ARC-AGI: - Astra scores 63% on ARC-AGI-3, 99% via a new provider adapter harness - It surpasses human performance on 96% of ARC-AGI-3 levels - It builds the mos

It is inevitable that all AI will converge towards symbolic learning (i.e. modeling data by finding the shortest symbolic program that explains it), since that is the optimally efficient form of AI. B

Great paper from Google and colleagues. It proposes an interesting approach to improve agents on long-horizon tasks. Long-running agents slow down and start poisoning their own context. Both symptoms

How fast is the Claude Code plugin ecosystem actually growing? Plugin-touching commit activity grew 8.8x in the six months after the initial launch. Researchers studied 1,926 repositories hosting plug

The independent review of the OpenAI Hugging Face incident, supposedly a watershed moment in cybersecurity, wasn't done by a cybersecurity firm and the authors have no cybersecurity experience. That's

剑桥这回直接扔王炸了！！ AI & ML经典教材全集直接免费开放，PDF随便下。 想学机器学习又不想被割韭菜买高价课的，这十本刷完，底子基本就硬了。 顺序从易到难排好了： 1️⃣ 《机器学习理解》——理论算法一把抓，零基础入门首选 🔗 https://cs.huji.ac.il/~shais/UnderstandingMachineLearning/understanding-machine-le

Banger paper from Stanford on efficient test-time scaling. If you run agents that think for a long time, this one is worth your time. (bookmark it) Long reasoning keeps the entire trace in memory thro

Interesting paper on prompt optimization. They claim that a single-lineage prompt optimizer just matched GEPA on a smaller rollout budget. Prompt optimization has been drifting toward heavier machiner

// Memory is what breaks long-horizon agents // It's undeniable how important memory/recall is for long-horizon tasks. If you are building for long-horizon tasks, this is a great read. (bookmark it) T

Cohere's Chief AI Officer @jpineau1 has been named to this year's TIME 100AI list, recognizing the world's most influential people in artificial intelligence. Joelle has been shaping modern research i

If you maintain a skill library for long-horizon agents, this one is worth your time. (bookmark it) It discusses one of most common topics I get asked about these days. It shares some good ideas on ho

One way to think of current AI is as a big sponge for patterns. It absorbs and operationalizes any pattern it is exposed to (albeit with very low data efficiency at training time). Once you can progra

arXiv:2411.09686v4 Announce Type: replace-cross Abstract: Regressing a function F on R^d without incurring the statistical and computational curse of dimensionality requires exploitable structure. Com

こちらのポジション、とても面白い環境でLLMの研究開発に取り組めます！意外と小規模なチームで取り組んでおり、様々な能力を持った優秀なメンバーがいるので学びもめちゃくちゃ多いです！最近は論文やProductなどいろいろな形で成果を公開できるのも魅力だと思います！少しでもご興味ある方はぜひ🙌 【採用情報】Member of Technical Staff (LLM Development) の募集を開