Model Releases
Nex-N2.5-mini-MLX-4bit on Apple M5 Max — 133.6 tok/s — llm-bench.io
Another new model dropped in the course of this week that is well deployable on consumer hardware: Nex N2.5 Mini I went with the recommended settings for the best generation quality and ran a few benc
Another new model dropped in the course of this week that is well deployable on consumer hardware: Nex N2.5 Mini I went with the recommended settings for the best generation quality and ran a few benchmarks: temperature: 0.7 top_p: 0.95 top_k: 40 reasoning_effort: high I must say, the outcome is not bad at all - really good generation speed and prompt processing, okay memory footprint and good quality across the board. Will for sure give it a try to fuel my agents and might also try to do some coding with it. All benchmarks run I did you can find here: https://llm-bench.io/models/nex-n2-5-mini-mlx-4bit Quant I used: https://huggingface.co/abenzerps/Nex-N2.5-mini-MLX-4bit submitted by /u/DerTomsn [link] [comments]
Related
- Deepseek V4 Flash 2-bit quant is the first model I can run locally that achieves 100% in this SQL benchmark
- 3 days benchmarking most llama.cpp flags on my weird 40gb vram laptop + tb4 egpu setup. Got +70% generation, +40% prefill, 60k more context, and filed a bug in llama around MTP. What I learned.
- A 2.6B model with tool calling and 128K context now runs at 30 tok/s on a phone
Source: r/LocalLLaMA | 2026-09-12