Are you ready for Le Chaton FAT or still wasting money on GPUs?

According to rumors (spread by myself) Le Chaton FAT will be 26T-a3b and I AM READY for it. Let's be real, I can't afford that many 5060Ti, so I got 12x Gen 4 3.2 TB (two per card). This gives me about 60GBs bandwidth on 30TB. Added 256gb ddr4 just for kv cache, but I can also write KV-cache to the disks, these are high endurance drives. Are you ready for the next era of local inference? Jokes aside, this is what I use for my HF_HOME - model and dataset storage. I'm also setting up a few containers, but it's not running any heavy compute stuff, the CPU is only a 3945WX (12c/24t). The pool is actually raidz2, so I avoid all that worry of having agents delete stuff. I just zfs snapshot and no rm -rf foo-bar has me sweat. Full Specs CPU: Threadripper 3945WX CPU cooler: Arctic Freezer 4U-M Rev. 2 RAM: 8x32GB DDR4 ECC REG 2133 GPU: None Motherboard: Asrock WRX80 Creator Case: Silverstone SST-RM47-502I PSU: 1600W Corsair Storage: 1TB NVMe 6x Intel SSD D7-P5608 6.4TB This is very much a product of multiple marketplace heists. The SSDs are on a PCIe x8 interface, but it's actually two x4 interfaces, so you need bifurcation x4x4x4x4 on every slot. submitted by /u/reto-wyss [link] [comments]

Related

• 2× Radeon R9700 for Local AI Was Choosing AMD Instead of NVIDIA a Mistake Without CUDA?
• I compared all specs of the major GPUs/machines that are being used here, because bandwidth is not everything. Some of ya'll need a reality check.
• Do people building local LLM rigs track RTX Ada/workstation card prices, or just consumer cards like the 5090?
• Qwen3.6 27B on dual RTX 5060 Ti 16GB with vLLM: ~60 tok/s, 204k context working
• I've been tracking RTX 5090 prices across EU stores since March, it's up €1,061 and still climbing

Source: r/LocalLLaMA | 2026-08-02