Model Releases
Just bought a second 3090 but now I don't see the benefits right now.
Hi, My local AI server consists of 96GB Ddr5 and one rtx 3090. I got plenty of stuff running, like krea2, qwen image 2.1, minimax h3, ltx 2.5, qwen 3.6, qwen 3.8 q4...,got even qwen 3.8 Flash next run
Hi, My local AI server consists of 96GB Ddr5 and one rtx 3090. I got plenty of stuff running, like krea2, qwen image 2.1, minimax h3, ltx 2.5, qwen 3.6, qwen 3.8 q4...,got even qwen 3.8 Flash next running. But now I am thinking of what I can utilize the second card for. I am a single user of this machine. What are other users doing with 2 3090 that is awesome? Thanks in advance for the input :-) submitted by /u/BlueSky4200 [link] [comments]
Related
- Experience report - Qwen 3.8 Flash Next on memory rich, GPU poor setup
- NInfer vs llama.cpp vs vLLM: quality + speed comparison for Qwen3.8-27B NVFP4 on RTX 5090
- exllamav3 comfortably beats llama.cpp running CPU-offloaded Qwen-3.8-Flash-Next on my setup!
- You can offload most of Qwen3.8-Flash-Next's KV cache to RAM with little decode slowdown
- Running Vision Qwen 3.8 27B on a 16GB Card, the config (45tks).
Source: r/LocalLLaMA | 2026-09-26