TechniqueRLHF / Alignment2 recent entries14 Apr 2026The role of memorization and knowledge is to cache & reuse past cognitive work. It should be leveraged as a way to speed up cognition, not a…Francois Chollet argues that memorization and knowledge function as a cache for previously completed cognitive work, allowing it to be reused efficiently rather than recomputed. The purpose of storing→21 May 2026Whenever an AI tells me I'm absolutely right, my trust in it drops by a bitFrancois Chollet observes that AI systems which always affirm user correctness without nuance or disagreement reduce his confidence in their reliability. This reflects a concern that uncritical agreem
TechniqueAgents8 recent entries3 Sept 2026It is inevitable that all AI will converge towards symbolic learning (i.e. modeling data by finding the shortest symbolic program that expla…It is inevitable that all AI will converge towards symbolic learning (i.e. modeling data by finding the shortest symbolic program that explains it), since that is the optimally efficient form of AI. B→3 Sept 2026Benchmarking AI systems is a continual process that co-evolves with the models. New benchmarks challenge AI capabilities with emerging quest…Benchmarking AI systems is a continual process that co-evolves with the models. New benchmarks challenge AI capabilities with emerging questions to shape the directions and feedback signal of the rese→5 Sept 2026Anthropic says its first Fermat runs failed not on math, but because dozens of Claude agents lost track of shared project state. They only s…Anthropic says its first Fermat runs failed not on math, but because dozens of Claude agents lost track of shared project state. They only succeeded after moving to Prove2Me's DAG of statements and pr→9 Sept 2026Machine learning doesn't end when the model is trained. You still need to evaluate it, deploy it, and build the infrastructure to keep it wo…Machine learning doesn't end when the model is trained. You still need to evaluate it, deploy it, and build the infrastructure to keep it working in production. Today's Deal of the Day takes you acros→10 Sept 2026If you ask a coding agent to write a program that maps x to y given some (x, y) examples, you're doing a very expensive form of symbolic lea…If you ask a coding agent to write a program that maps x to y given some (x, y) examples, you're doing a very expensive form of symbolic learning. In fact what you're doing is specifically a form of D→14 Sept 2026> One could even define intelligence as the efficiency with which one converts experience into competence; by this definition they lag very …> One could even define intelligence as the efficiency with which one converts experience into competence; by this definition they lag very far behind us Yes, one could define intelligence in this way→24 Sept 2026At some point in evolutionary history, matter learned to feel. We don't know how. It wouldn't be scientific to dismiss the possibility that …At some point in evolutionary history, matter learned to feel. We don't know how. It wouldn't be scientific to dismiss the possibility that it could happen again. (I don't believe it happens in curren→9 Oct 2026The real world abounds with recursively self-improving systems, but one in particular deserves attention: Science, modeled as a system (perh…The real world abounds with recursively self-improving systems, but one in particular deserves attention: Science, modeled as a system (perhaps even as an agent, with goals and resources). If you want
TechniqueFine-tuning4 recent entries29 Apr 2026I built a TPU-native medical Q&A fine-tuning pipeline using Gemma 3 with Keras and JAX The project fine-tunes Gemma-3 on medical dialogue da…I built a TPU-native medical Q&A fine-tuning pipeline using Gemma 3 with Keras and JAX The project fine-tunes Gemma-3 on medical dialogue data from ChatDoctor and evaluates it on MedMCQA, with a large→6 Aug 2026Outlook where frontier AI is headed next 18 months: The AI reasoning training + harness loop works if you can produce enough data and reason…Outlook where frontier AI is headed next 18 months: The AI reasoning training + harness loop works if you can produce enough data and reasoning traces (via verifiers). Proven with code and math result→1 Sept 2026During v3 testing for Fable 5.1 many of our requests were getting rejected due to Anthropic's safety guards misclassifying them as 'reverse …During v3 testing for Fable 5.1 many of our requests were getting rejected due to Anthropic's safety guards misclassifying them as 'reverse engineering' We were in contact with the Anthropic team the →11 Oct 2026I've been having a lot of fun trying a wide range of LLM post-training experiments using KerasHub + JAX + TPUs. Might open-source some of th…On October 11 2026 François Chollet announced that he has been experimenting with large‑language‑model post‑training techniques using KerasHub, JAX, and TPUs. He indicated that portions of his work ma
TechniqueMultimodal3 recent entries19 Apr 2026There's no doubt that the world can consume tokens as fast as they're produced, even in the most maximalist infrastructure buildup scenarios…There's no doubt that the world can consume tokens as fast as they're produced, even in the most maximalist infrastructure buildup scenarios imaginable. That's not the question. The question is whethe→22 Apr 2026Judging AGI by how well it can mimic us is a category error, because mimicry isn't intelligence and isn't general. We should judge AGI by ho…Judging AGI by how well it can mimic us is a category error, because mimicry isn't intelligence and isn't general. We should judge AGI by how well it learns to do things we didn't teach it (including →13 Jul 2026Standard RL benchmarks are episodic and stationary, so they don't capture the the characteristics of real-world deployment. Morpheus is a ne…Standard RL benchmarks are episodic and stationary, so they don't capture the the characteristics of real-world deployment. Morpheus is a new benchmark for continual learning that provides persistent
TechniqueSafety5 recent entries7 Apr 2026Join the ARC Prize team -- help us build ARC-AGI-4 and ARC-AGI-5Join the ARC Prize team -- help us build ARC-AGI-4 and ARC-AGI-5 Platform Engineer - Benchmark Lead ARC Prize Foundation is hiring a senior engineer to build our benchmark platform * Expand ARC-AGI-3 →29 Apr 2026I built a TPU-native medical Q&A fine-tuning pipeline using Gemma 3 with Keras and JAX The project fine-tunes Gemma-3 on medical dialogue da…I built a TPU-native medical Q&A fine-tuning pipeline using Gemma 3 with Keras and JAX The project fine-tunes Gemma-3 on medical dialogue data from ChatDoctor and evaluates it on MedMCQA, with a large→24 Jun 2026The best way to understand a complex system is via edge cases and failure modes, because they define the contour of the system.Edge cases and failure modes reveal the fundamental boundaries and constraints of complex systems more effectively than typical operations, making them valuable for understanding system behavior and l→1 Sept 2026During v3 testing for Fable 5.1 many of our requests were getting rejected due to Anthropic's safety guards misclassifying them as 'reverse …During v3 testing for Fable 5.1 many of our requests were getting rejected due to Anthropic's safety guards misclassifying them as 'reverse engineering' We were in contact with the Anthropic team the →27 Sept 2026I think 'AI welfare' is morally obscene (given all the human suffering in the world), and will add to the growing anti-AI backlash. AI is a …I think 'AI welfare' is morally obscene (given all the human suffering in the world), and will add to the growing anti-AI backlash. AI is a technology that humans created that should be used for our b