Industry
Lots interesting in this, but particularly: “Legitimate AI distillation used to create smaller, more efficient models plays a vital role in …
Lots interesting in this, but particularly: “Legitimate AI distillation used to create smaller, more efficient models plays a vital role in this open innovation ecosystem” Smol models getting govt sea
Lots interesting in this, but particularly: “Legitimate AI distillation used to create smaller, more efficient models plays a vital role in this open innovation ecosystem” Smol models getting govt seal of approval 👀 More amazing edge models please. We have information that Moonshot AI distilled Anthropic’s Fable for the development of its K3 model. To do this they developed a sophisticated internal platform to conduct large scale distillation against U.S. models, allowing them to quickly switch between multiple methods of a…
Related
- To train better open models, we need predictable scaling. Delphi is Marin’s first step: we pretrained many small models with one recipe, the…
- ⚡️After weeks of hard work, we're thrilled to fully open-source HY World 2.0 today -- full inference code and all models! Build, explore, an…
- There will be an open source fable-level model that runs on a base MacBook mini / Air or equivalent. I don’t think people have realised this…
- We have seen multi model harnesses for cheaper & faster tasks What about for the hardest challenges? What about open source? Proud to share …
Source: Emad Mostaque (X) | 2026-07-22