Local Ai
GPU issue
A month i setup a proxmox server using spare parts like a z270 i7 7700k and 2x8 2666 but since i don't have any hardware acceleration i was planning to pass down my rx 580 8GB to my server but i heard
A month i setup a proxmox server using spare parts like a z270 i7 7700k and 2x8 2666 but since i don't have any hardware acceleration i was planning to pass down my rx 580 8GB to my server but i heard AMD gpu's work less easily than nvidia. Point is, i was wondering if my gpu could handle 8B ollama with 4bit quantization i wanna use my AI model so it can help me troubleshoot my machines ask coding questions general questions etc. Is it possible? submitted by /u/Antex332 [link] [comments]
Related
- Budget AI GPUs - is there a middleground between 3060 and 3090?
- Trying to setup two LLM’s to run on 2 gpus separately but simultaneously on one machine.
- Ollama with Docker OpenWebUi using CUDA/GPU Support container - Can't get it working
Source: r/ollama | 2026-08-24