Local Ai
2× Radeon R9700 for Local AI Was Choosing AMD Instead of NVIDIA a Mistake Without CUDA?
Hello together I decided to go with 2× Radeon AI PRO R9700 GPUs (64 GB total VRAM) for my local AI server. However, I keep reading that AMD/ROCm is still not as mature as NVIDIA/CUDA when it comes to
Hello together I decided to go with 2× Radeon AI PRO R9700 GPUs (64 GB total VRAM) for my local AI server. However, I keep reading that AMD/ROCm is still not as mature as NVIDIA/CUDA when it comes to running local LLMs. Is running local AI workloads on AMD/ROCm a realistic choice today, or should I consider switching back to NVIDIA? My goal is to get the maximum performance and capability out of the system. I don’t want to sacrifice model quality, speed, or compatibility compared to NVIDIA. How well does the current stack work with ROCm (vLLM)? Are there still major limitations, or has AMD improved enough that it is a solid alternative for local LLM workloads? Thanks for your insights and experiences! submitted by /u/Syosse-CH [link] [comments]
Source: r/LocalLLaMA | 2026-07-30