Industry
Some thoughts on the purported distillation timeline. 1. You don't need that many Fable tokens to distill on top of the alleged ~50b Anthrop…
Some thoughts on the purported distillation timeline. 1. You don't need that many Fable tokens to distill on top of the alleged ~50b Anthropic claimed Moonshot AI distilled in Feb. ~10b, about $60k wo
Some thoughts on the purported distillation timeline. 1. You don't need that many Fable tokens to distill on top of the alleged ~50b Anthropic claimed Moonshot AI distilled in Feb. ~10b, about $60k worth. 2. Time on cluster to tune 10b tokens is a few hours once you have them We have information that Moonshot AI distilled Anthropic’s Fable for the development of its K3 model. To do this they developed a sophisticated internal platform to conduct large scale distillation against U.S. models, allowing them to quickly switch between multiple methods of a…
Related
- You should really all try Opus Fable low mode versus high or ultracost It's a good enough model to semi one-shot most things and this uses f…
- You don't need Fable for the most complex tasks, from training models for protein prediction to optimising compilers Our open source Zenith …
- Lots interesting in this, but particularly: “Legitimate AI distillation used to create smaller, more efficient models plays a vital role in …
- There will be an open source fable-level model that runs on a base MacBook mini / Air or equivalent. I don’t think people have realised this…
Source: Emad Mostaque (X) | 2026-07-23