Local Ai
what can you do with smaller gpu's?
I mean gpu's with 6/8/12GB vram. All discussion around llm/AI these days is around coding, and this is probably too small for agentic coding models. Are there models that can run in these that can acc
I mean gpu's with 6/8/12GB vram. All discussion around llm/AI these days is around coding, and this is probably too small for agentic coding models. Are there models that can run in these that can accomplish useful tasks? eg things like helping organize your digital stuff, classification, image/text analysis, voice/tts etc and other stuff? Or do those tasks also need tool calling and agentic behaviour for best use? For people who have cheaper, older gpu's, what do you use them for? submitted by /u/ECrispy [link] [comments]
Source: r/LocalLLaMA | 2026-10-22