Model Releases
Which current local models that can run within 128GB generate the best SVG pelicans?
I used a famous Simon Willison's pelican riding a bicycle prompt on the biggest local LLMs that can run on 128GB Apple Silicon. U used quantizations by Unsloth. Qwen3.8 Flash-Next gives a lot of detai
I used a famous Simon Willison's pelican riding a bicycle prompt on the biggest local LLMs that can run on 128GB Apple Silicon. U used quantizations by Unsloth. Qwen3.8 Flash-Next gives a lot of details. DeepSeek V4 Flash is strangely underwhelming. Qwen3.8 27B still rocks, and I like its consistent minimalism. Is Qwen3.8 27B still large at 31GB? It is! But for this tasks 2-bit quantizations (at around 12GB) will give the same results. For more complicated coding, 4-bit are more than enough. RTX cards are well enough! See: Benchmarking Qwen3.8 27B quantizations: 4-bit holds up, 1-bit collapses - Terminal-Bench 2.1, GPQA Diamond and IFBench Do Qwen3.6 27B quantizations break the pelican? submitted by /u/pmigdal [link] [comments]
Related
Source: r/LocalLLaMA | 2026-09-01