Model Releases
Any 12gb VRAM users out there?
Hi! I've been following this community for quite a while and have difficulty figuring out what to put on my 3080 12gb - I know Qwen 3.6 35B 3A was the go-to choice when it first came out, but I'm curi
Hi! I've been following this community for quite a while and have difficulty figuring out what to put on my 3080 12gb - I know Qwen 3.6 35B 3A was the go-to choice when it first came out, but I'm curious if there are any other models / specifically optimized models that meaningfully benefit from the extra 4gb of VRAM over 8gb while still being usable under 16gb. My workflow is agent heavy, but more for a personal secretary and manager, and less coding heavy. Thanks! submitted by /u/jqwl [link] [comments]
Related
- 12GB VRAM gang, what's our plan?
- Qwen3.8-Flash-Next in llama.cpp vs SGLang vs FreeToken: 35s vs 258s to first token at full context. My findings on new PRs coming to engines.
- What settings do you use for running Qwen3.8-Flash-Next in llama.cpp?
- After pushing 1M+ tokens through Qwen 3.8 27B, here is my optimal llama.cpp config for 16GB VRAM (73k Context, Agentic Coding)
Source: r/LocalLLaMA | 2026-09-11