Research
I support open-source models distilling what commercial companies distilled for free from the entire internet. I published distillation for …
I support open-source models distilling what commercial companies distilled for free from the entire internet. I published distillation for free in 1991 in Europe - this was copied in the US and in Ch
I support open-source models distilling what commercial companies distilled for free from the entire internet. I published distillation for free in 1991 in Europe - this was copied in the US and in China (https://x.com/SchmidhuberAI/status/1608870559609421831) We have information that Moonshot AI distilled Anthropic’s Fable for the development of its K3 model. To do this they developed a sophisticated internal platform to conduct large scale distillation against U.S. models, allowing them to quickly switch between multiple methods of a…
Related
- [[a-recent-nyt-article-by-cademetz-1-claims-that-neural-networ|A recent NYT article by @CadeMetz [1] claims that neural network distillation was first developed in 2015 by a team of Google researchers in…]]
- InfiGFusion: Graph-on-Logits Distillation via Efficient Gromov-Wasserstein for Model Fusion
- Privileged Foresight Distillation: Zero-Cost Future Correction for World Action Models
Source: David Ha (X) | 2026-07-23