Local Ai
My only real use case for a local AI use is document management, how much VRAM do I realistically need for a good experience?
I just want to use paperless-ai and be able to ask questions relative to it. Bonus points if I could use it with home assistant but that's not the focus. I just can't see needing a 32 GB VRAM GPU for
I just want to use paperless-ai and be able to ask questions relative to it. Bonus points if I could use it with home assistant but that's not the focus. I just can't see needing a 32 GB VRAM GPU for just that, but I don't want to buy a GPU only to find out that "yeah, it's technically feasible but not a good user experience" The GPU's I tend to find at good prices are in the 8-12 GB range, would my use case be a good one to just get a 12 GB and run a 6-10 gb model? submitted by /u/pjdonovan [link] [comments]
Related
- MI25 for 80-100€ worth it?
- Please talk me out of this GPU upgrade
- Do people building local LLM rigs track RTX Ada/workstation card prices, or just consumer cards like the 5090?
- 2× Radeon R9700 for Local AI Was Choosing AMD Instead of NVIDIA a Mistake Without CUDA?
Source: r/LocalLLaMA | 2026-09-05