What people call 'distillation' is a super common practice (you use other models to benchmark your model, to evaluate your inputs or to add …

What people call "distillation" is a super common practice (you use other models to benchmark your model, to evaluate your inputs or to add a little bit to your datasets) that in my opinion should be covered by fair use (just like using public data is), especially when the resulting models are open-source as it benefits all and helps break out monopolies that are strongly forming in AI LIVE TRIAL UPDATE: OpenAI's counsel asked Musk whether xAI has ever "distilled" technology from OpenAI. Musk: "Generally AI companies distill other AI companies." "Is that a yes?" Savitt asked. Musk: "Partly."

Source: Clem Delangue (X) | 2026-04-30