Model Releases
Qwen3.6 35b Q2_XXS: Being GPU poor in 2026 is not so bad
A potato can create a very cool RPG in 24 minutes Laptop I3 8gb RAM 0gb VRAM, Windows 11 llama-server.exe --host 0.0.0.0 --port 8080 -m modelsqwen3.6-35b-InstructQwen_Qwen3.6-35B-A3B-IQ2_XXS.gguf -c 8
A potato can create a very cool RPG in 24 minutes Laptop I3 8gb RAM 0gb VRAM, Windows 11 llama-server.exe --host 0.0.0.0 --port 8080 -m modelsqwen3.6-35b-InstructQwen_Qwen3.6-35B-A3B-IQ2_XXS.gguf -c 8192 -n 8192 -tb 4 -b 512 -ub 512 --cache-type-v q8_0 --cache-type-k q8_0 -fa auto -ngl 0 --temp 0.0 --reasoning off MODEL: https://huggingface.co/bartowski/Qwen_Qwen3.6-35B-A3B-GGUF/resolve/main/Qwen_Qwen3.6-35B-A3B-IQ2_XXS.gguf (I use the Instruct model to avoid so many reasoning tokens) RESULT: 24 min, 3 t/s PROMPT: Create a simple RPG Zelda-like 2d world character attacking the enemies KEYS: W up S down A left D right F attack A guy with a sword kills enemies. Earn points, level up, and gain strength. Infinite loop of enemies randomly appearing. Output: Single HTML File submitted by /u/ML-Future [link] [comments]
Related
- 16 GB VRAM purgatory discussion thread
- Is it possible to run it with a combined memory setup: 16 GB VRAM + 64 GB RAM + SSD for offloading n-grams?
- After pushing 1M+ tokens through Qwen 3.8 27B, here is my optimal llama.cpp config for 16GB VRAM (73k Context, Agentic Coding)
- Ornith-1.5 9B might not be bad at all
- Current smallest usable coding model
Source: r/LocalLLaMA | 2026-09-03