Local Ai
Waiting for a 122B because of world knowledge?
Any LLM will hallucinate the world knowledge, even a 3T model. Use a 4B with a kiwix skill and local Wikipedia, 50gb and no more hallucinated world knowledge. Ask your coding agent to build your own,
Any LLM will hallucinate the world knowledge, even a 3T model. Use a 4B with a kiwix skill and local Wikipedia, 50gb and no more hallucinated world knowledge. Ask your coding agent to build your own, with your rules and eventual fallback access to internet knowledge for what's updated realtime like news, or isn't public on Wikipedia. EDIT: I forgot to mention that adding a simple agent loop with a well crafted looping/research skill may help less intelligent LLMs to be good enough for getting grounded knowledge very fast. I did it with my old laptop, 10 years old with 4gb vram. And by eyeball - on world knowledge - it's faster and more precise than any huge LLM running on a costly rig, occupying hundred of storage GB and consuming a lot of energy. IMO submitted by /u/PieBru [link] [comments]
Related
- I benchmarked classic vector RAG vs Google's new OKF format vs both combined — same corpus, same 7 questions, all local (Ollama + ChromaDB)
- I bundled a fully local LLM inside my Unity game. No internet, no cloud, no API key. The conversation is the gameplay.
- [[paper-intern-s2-mobius-foundation-model-with-decoupled-knowl|[Paper] Intern-S2-Mobius: Foundation Model with Decoupled Knowledge and Reasoning]]
Source: r/LocalLLaMA | 2026-08-19