Model Releases
llama.cpp v0.7.0, 128GB Mac/Spark: llama serve -hf ggml-org/Qwen3.8-Flash-Next-GGUF:IQ4_NL --spec-type draft-mtp --lazy-mode on
In October 2026 Georgi Gerganov posted that he ran **llama.cpp v0.7.0 on a 128‑GB‑RAM Mac (Spark)**, serving the Qwen3.8‑Flash‑Next GGUF model in IQ4_NL precision. The command used was `llama serve -h
In October 2026 Georgi Gerganov posted that he ran llama.cpp v0.7.0 on a 128‑GB‑RAM Mac (Spark), serving the Qwen3.8‑Flash‑Next GGUF model in IQ4_NL precision. The command used was llama serve -hf ggml-org/Qwen3.8-Flash-Next-GGUF:IQ4_NL --spec-type draft-mtp --lazy-mode on. The post received 9,316 views and a modest amount of interaction (17 likes, 154 reposts).
Related
- Qwen3.8-Flash-Next (UD-IQ4_XS) on 2x RTX 3060 + 7800X3D, from initial 36 tps prefill to 400 tps and other benchmarks (-sm tensor trap) + VRAM/RAM usage
- Qwen Flash Next MTP work restarted
- b10415
- b10413
Source: Georgi Gerganov (X) | 2026-10-16