Model Releases
[RELEASE] - SupraGDN-5M - a tiny GatedDeltaNet model competing with other community while models trained on MUCH less data!
https://preview.redd.it/5rs3d7vtgbnh1.png?width=950&format=png&auto=webp&s=df828c1146bc6167bd09d3300018aba426fc1ab2 Hey, r/LocalLLaMA ! We are releasing SupraGDN-5M. It's a tiny GatedDeltaNet (GDN1) b
https://preview.redd.it/5rs3d7vtgbnh1.png?width=950&format=png&auto=webp&s=df828c1146bc6167bd09d3300018aba426fc1ab2 Hey, r/LocalLLaMA ! We are releasing SupraGDN-5M. It's a tiny GatedDeltaNet (GDN1) being trained on 2B tokens. https://preview.redd.it/8gzkf0kggbnh1.png?width=735&format=png&auto=webp&s=9517d3eb88582a57b911bacd8386fca6c59f4fe9 As you can see in the benchmark table above, SupraGDN-5M ("Supra-5M-GatedDeltaNet" in the image!) is almost as good as the other models while being trained on MUCH less data! This is because of the GDN architecture - and we think it can be taken even more far :D Link to the model: https://huggingface.co/SupraLabs/SupraGDN-5M Give us a follow on HF and feel free to provide feedback and ask questions 🤗 More of SupraLabs coming soon... e.g. the Supra3-family 🔥🤩 submitted by /u/LH-Tech_AI [link] [comments]
Related
- Döner Bench DeepSeek-V4-Flash IQ2_XS running on a single RTX 3090
- New stealth model Ox Alpha look like glm or mimo new model
- [[big-dataset-release---supralabsreasoning-corpus-4k-5m-v1---t|[BIG DATASET RELEASE] - SupraLabs/reasoning-corpus-4K-5M-v1 - Train your tiny SLMs to think!]]
- I released Inflect v2: two ultra-tiny complete TTS models under 4M and 10M parameters
Source: r/LocalLLaMA | 2026-09-03