Local LLMs for AI Agents

Hey everyone, I'm trying to set up a local LLM on my machine. My goal is to use it with Qwen Code or OpenCode to help me out with small to medium sized tasks, but nothing too big. I tested many different variations of Qwen models, but either they were very slow because they didn't fit in my VRAM or they were just not working. I also tried some smaller models which fit completely in my VRAM, but they failed with tool calls or other stuff. My specs: - i9 Ultra 285H - RTX 5070 8GB - 64GB DDR5 I know my VRAM is kinda low, but is there any model that would fit my needs? I appreciate your help. submitted by /u/sicmek [link] [comments]

Source: r/ollama | 2026-08-25