Model Releases
Models to download for M5 Ultra 512GB
Just ordered a TB5 enclosure plus 4TB SSD to prepare for M5 Ultra 512GB. I am planning to download the following models in advance. Would like to ask the M3 Ultra 512GB owners whether the quants are t
Just ordered a TB5 enclosure plus 4TB SSD to prepare for M5 Ultra 512GB. I am planning to download the following models in advance. Would like to ask the M3 Ultra 512GB owners whether the quants are the "best" performing ones given the 512GB constraint. What's the max size of context length you can get for GLM-5.3 and Kimi-K3? If possible, can you post your pp and tg for them? Does it make sense to run 8-bit models for glm-5.3-flash, qwen3.8-flash-next and DSV4F? Are there other big models worthy to download? Thanks a lot in advance. Model RAM pipenetwork/GLM-5.3-MLX-mixed-4_8bit 427.8GB pipenetwork/GLM-5.3-Flash-MLX-mixed-4_8bit 181.9GB pipenetwork/Qwen3.8-Flash-Next-MLX-mixed-4_8bit 106.2GB pipenetwork/DeepSeek-V4-Flash-MLX-mixed-4_8bit 165GB pipenetwork/Kimi-K3-REAP73-MLX-mxfp4-q8 451GB submitted by /u/Ok_Warning2146 [link] [comments]
Related
- Deepseek V4 Flash on SlopCodeBench
- [[release-wintermix-qwen35-122b-a10b-in-native-mlx-an-82-gib-b|[Release] WinterMix — Qwen3.5-122B-A10B in native MLX: an 82 GiB build that beats 94–95 GiB quants, plus a 68 GiB build for agent swarms]]
- LFM2.5-2.6B is out
Source: r/LocalLLaMA | 2026-08-31