Local Ai
Aurora-80K releases! A modern tiny language model.
I'm introducing Aurora-80K, a small language model with exactly 80 thousand parameters. It uses a factorized 4,096-token vocabulary despite having only 80K parameters. The benchmarks: Wikitext-2 BPB:
I'm introducing Aurora-80K, a small language model with exactly 80 thousand parameters. It uses a factorized 4,096-token vocabulary despite having only 80K parameters. The benchmarks: Wikitext-2 BPB: 3.2902 BLiMP: 52.31% Arc-Easy: 26.05% More information about the model is available on the model page on Huggingface. if there's any questions I'll happily answer them! submitted by /u/Tall_Abrocoma_3533 [link] [comments]
Related
- Is Ling 3 tiny underrated for its size?
- [[massive-tiny-release---supra2-medium-base---a-tiny-25m-param|[MASSIVE TINY RELEASE] - Supra2-Medium-Base - a tiny 25M parameters model competing heavily with our previous 50M model!]]
- AntLing’ve open-sourced 6 Base Model checkpoints for Ling-3.0-tiny & Ling-3.0-flash, covering pre-trained, mid-trained, and WSM-merged stages.
Source: r/LocalLLaMA | 2026-08-20