Ornith-1.5 9B might not be bad at all

(my own experience) I have a mid-range gaming laptop from 2024 with 4GB VRAM and 16GB RAM. There is nothing that I can run other than small models at humble t/s. I mostly use the models to generate scripts for medical physics research (don't worry, I verify them before any use, no one is getting vaporized). My "benchmark" consists of 6 typical tasks, nothing too fancy. I have tried Ling-3.0 Tiny, Qwen 3.5 4B, Empero's 2B and 4B distills, and now Ornith's new 9B model. 3.5 4B did the worst, only 2/6 tasks, Ling and Empero's did 3/6, and could not get the other 3 to work with any amount of feedback. Ornith one shot 5/6 tasks with no problem. It couldn't do one of the tasks, but it took feedback and improved parts of the code, being the first model in the set to do so. It also got the car wash question right! submitted by /u/zippydazoop [link] [comments]

Related

• The small open weight models are scarier in AI development
• A collection of small domain-specific benchmarks for local models (30+ and growing)
• Making small local models actually useful for coding
• Current smallest usable coding model

Source: r/LocalLLaMA | 2026-08-19