Model Releases
Tested Muse Glimmer locally on coding with OpenCode & agentic work
Ran the model with quants (Q4) by Unsloth with latest (build from master) llama.cpp server. It takes ~20GB ram running on M5 Pro with 48GB at about 17t/s. Didn't do any reasoning loops/overthinking. O
Ran the model with quants (Q4) by Unsloth with latest (build from master) llama.cpp server. It takes ~20GB ram running on M5 Pro with 48GB at about 17t/s. Didn't do any reasoning loops/overthinking. Overall, sits below Qwen3.6 27B, wasn't able to get good code (frontend and backend) results. On the positive side, it didn't fail any tool calls. Your opinions/findings? Watch more: https://www.youtube.com/watch?v=_5wKhkUT438 submitted by /u/curiousily_ [link] [comments]
Related
- Achievable 253 t/s - unsloth/Muse Glimmer 30B UD-Q5_K_M on a 5090
- Please Share Your Experience About Muse Glimmer
Source: r/LocalLLaMA | 2026-08-10