Local Ai
home lab assistant llm
hey so im currently working to integrate a locally ran llm to control home assistant (through tool calling, no direct connection) so i can use a voice input without needing very specific commands. Its
hey so im currently working to integrate a locally ran llm to control home assistant (through tool calling, no direct connection) so i can use a voice input without needing very specific commands. Its just a fun little project, but im trying to determine what hardware i would need for this, in the range between a pi 5 8gb or my old pc (i5 7500, 16gb ddr4 with a 1070 ti 8gb vram), which obviously depends on which model i use. My question is how small of a model i can get away with so that it stil works. the newer popular models are al like 20 gb with a context size of 256k which is clearly not gonna work with my setup but also probably really overkill for what i want it to do, which is basically conferting normal conversation into tool calls. Any recommendations, insights or people who have tried something similar? submitted by /u/stormbosman007 [link] [comments]
Related
- Ollama Cloud usage in your Chrome toolbar - and in Home Assistant
- I built a layer on top of Ollama that turns any spare PC into a private JARVIS — voice, 29 automations, knowledge brain, dashboard. One command, pick your profile.
- Building an offline AI + Home Assistant + prepper command center. Need architecture advice before RC1. Or for r/selfhosted:
Source: r/ollama | 2026-08-20