2x r9700 in one strix halo machine

https://preview.redd.it/5aon65uosrqh1.jpg?width=1000&format=pjpg&auto=webp&s=cd21ce0648b0ffa5dc07e66718a230f1f91d8a53 I have a GMKtec EVO-X2, it doesn't have oculink nor pcie slots, but it does have 2 nvme slots, one of each comes populated. So I bought a nvme to usb4 enclosure and 2x nvme to pcie adapters. nvme runs at pcie 4.0 x4, so while the adapter is an x16 slot and the gpus are pcie 5.0, they both run at pcie 4.0 x4. My first test was to see if tensor parallelism worked and I was dismayed it was slower than a single card. Turns out the llama.cpp vulkan doens't do tensor parallelism correctly. Switching to the rocm build, I got a decode speed up! But the prompt processing was only 70% of a single card. But fortunately that was also fixable. By default RCCL isn't enabled and adding -DGGML_HIP_RCCL=ON to my build restored the full prompt processing speed! Here are the final llama-bench results: Qwen3.8-27B-UD-Q4_K_XL.gguf benchmark tokens per second tensor parallelism pp512 1069 tensor parallelism tg128 37 single card pp512 1070 single card tg128 28 submitted by /u/Pyrolistical [link] [comments]

Quad R9700 AI Pro with vLLM-Radiance easily reaching 17,6k PP

Source: r/LocalLLaMA | 2026-09-21

Related