Knowledge catalogue
I recently started using my Mac Mini M4 as an always-on home server. It stays powered on most of the time, and right now I’m running my Discord bot on it. I’m thinking of gradually turning it into my
Hey r/ollama ! I'm Roy, solo dev of Observer. Observer is a free open-source agent that uses small local LLMs to monitor your screen, so you don't have to. This is the demo of the agent that controls
I maintain a starter kit where the LLM provider is a runtime-swappable DB row, not a hardcoded constant — OpenAI, Anthropic, or a local Ollama instance. Mostly so I can demo without burning API credit
We’ve released the complete VeriLoop E2 GGUF precision ladder, from the canonical BF16 reference down to a mixed-precision IQ1_M deployment tier. This post is specifically about the GGUF release and l
I run a personal always-on agent fleet — eight seats claiming work in parallel from a shared task board, routing across Anthropic, OpenAI, xAI, Google, and a local Ollama floor. This week the spend fo
Hi. I’m developing my first Python project (been at it a couple weeks). I built a very basic CLI ollama client. When a user sends a prompt I append the message to session['history'], save the sessio
Hi - I want to build a home server for Ollama. I want to connect to the server via my laptop and mobile devices to do research and run agents. What is recommended to get this going ? submitted by /u/R
Built this because I got tired of guessing whether a model would fit in my 6GB VRAM before downloading it, and because ollama.com's library doesn't let you sort by size. What it does: - Benchmarks Oll
Hey r/Ollama, I've been working on Presentation Forge, an open-source presentation/report generator that supports Ollama for local inference. I originally made it because I'm a university student and
Hey everyone, A major issue when building test environments or fine-tuning pipelines is balancing data realism with privacy. Pasting real internal/client data into cloud endpoints is a massive complia
I was having trouble searching and analyzing the different models that Ollama has available ( https://ollama.com/library ). I wanted to filter for specific model sizes and tooling capabilities, so I b
I’ve been experimenting with local AI lately, and one thing I’m finding interesting is what comes after getting a model running. Ollama makes local model access pretty straightforward, but for an actu
Guys I have a M4-mac air with 24 GB unified memory and I wanna run some local LLM model on my machine Currently I am working on building and RAG application which is mostly and QnA system but I wanna
I'm in a position where I didn't mean to go down this AI rabbit hole... I was looking into mental cognitions and how the mind is made up and learned that my old RTX 5k could run small models. So that
Context: we build an open-source (MIT) self-hosted database client and added a natural-language-to-SQL assistant that can point at a local runtime like Ollama instead of a hosted API. I want to share
Been building some multi-agent pipelines recently and the degradation in direct execution is insane. Whenever I pass a strict operational variable or hypothesis, the LLM triggers this 'Devil's Advocat
I am creating a local AI agent called 'Ontelic' for Windows. Ontelic returns to Ollama and also manipulates the actual Chrome. This is not for promotion but to share what we've learned. I'll give GitH
Yep. I just need tips honestly on UI layouts and how to build my shell for the local api offline. I’m using qwen and ollama and just want a simple discord style interface to declutter my brain to like
In light of recent events and media coverage, ai is in the spotlight and people are afraid. How I respond to those fears: If you are afraid of ai then you should also be afraid of all medical research
Is it just me or ollama serve command doesn't work at all. It uses a different directory than the systemd process, so it can't find any model or anything if you installed it using systemd ollama. Luck
Hey everyone, I made a simple script called MOMOS to run Ollama and small LLMs directly on your Android phone using Termux. It automatically handles PRoot-Distro (Debian), installs Ollama, and lets yo
Saw a new open 27B model release that looks like it could be interesting for the Ollama crowd: VeriLoop E2. It is a Qwen3.8-27B post-train aimed at code, mathematics, scientific reasoning, and agentic
Hey everyone, I’m new to running AI models locally and I’d like some advice. My laptop specs are: HP OMEN 15 CPU: Intel i5-8300H RAM: 16 GB GPU: NVIDIA GTX 1050 Ti 4 GB VRAM OS: Windows I’m planning t
Hey everyone, I'm getting into running LLMs locally with Ollama and would like some recommendations on which models I should realistically run with my hardware. My PC specs GPU: RTX 5060 Ti 16GB VRAM
I've been comparing and working on Gemma 4, Phi-4-Mini, and Qwen3-4B for local LLM use on an 8 GB Raspberry Pi 5. The results were indeed close, but each model has a different strength: Gemma 4 E2B: a
I keep trying to get it to write code and test simpel stuff but it never finsihes conversation its always stopping mid way. i installed it through qwen > ollama. currently removed it and trying to rei
Hi everyone, I wanted to ask you a question. I’m developing an app, and I’m currently putting together a list of the best AI models, especially, but not necessarily, in GGUF format and using Q4_K_M qu
So I'm using zcode and I'm not sure how to use ollama with it, it has a custom provider section https://preview.redd.it/uqomt844o0rh1.png?width=588&format=png&auto=webp&s=6cd21050f9f9c94d720205f9a4a03
🚀 THE EDGE AI FAMILY HAS ARRIVED. Today we’re opening the doors to a new generation of open-source and open-weight edge AI models from Next GenAi. Meet Rebekah AI 1.8B. 🧠⚡ Small enough to run at the e
I'm working on a computer game as a side project. I started it around 4 years ago, before I used any AI for coding. For most of that time I wrote everything myself. Later I started using GitHub Copilo
I tried putting up with it the last week or two but it's become unusable. I've tried GLM 5.3 & 5.3 Flash, GLM 5.2, and Deepseek V4.1 The inference and pp speeds have become unbelievably slow, I just c
Hey everyone, A few classmates and I got tired of the usual browser AI workflow: copying text from a documentation page, opening a separate tab, pasting it into a chatbot, and switching back. We also
I've been building an open-source AI workflow automation platform for a while now, mostly as a solo project. I recently checked the telemetry dashboard and was honestly surprised to see 1,062 telemetr
I’m building a personal local coding-agent project called Cody, using local 9B/14B models through Ollama. This is still a work in progress. It has not passed its full graduation process yet, and the l
A few days ago, I came across a post/comment saying that you can get better data privacy by using local Ollama models in a RAG pipeline instead of relying on cloud-hosted models/APIs. The explanation
been working on this thing called OpenComms for a bit. basically i keep multiple coding agents open at once, usually stuff like a lead, builder, reviewer etc, and i got sick of copying messages betwee
github repo: https://github.com/athulg93/vscode-localllm Alright, So i have made some major updates to this extension Update the git flow: Found out that there were some issues and the / part was a me
i have been using ollama cloud on old pro plan for monthes and this month i want to cancel my sub for personal reasons that i will not use ai for a month maybe. wondering if canceling plan and the upg
I'm one of the maintainers of SurfSense, so this is self-promotion. I'm posting here because the model-picking part is what I think this sub will have opinions on, and I want real feedback more than u
If anyone is interested in using Ollama with the Prism-ML model prism-ml/Bonsai-27B-gguf · Hugging Face I setup a repo with an install script that patches Ollama and pulls the Prism-LM llama.cpp code
You can now automate EDD (eval-driven development) with Coding Harness Agents > build a baseline LLM-based application > score every change with judge evals > keep what improves, reject what regresses
TV for the developer internet GitHub, Hacker News, dev.to, Hugging Face, and release notes, presented as channels you tune into, each auto-cycling its own stories, instead of five tabs to remember to
I have opened two tickets, one around a suspected problem and one around one I verified and then sent exact diagnostics over. The initial response was sent to their AI support, which just tried to tel
Hey everyone, Like a lot of people here, I’ve been experimenting with running models locally through Ollama. Athena started as a small experiment, but it quickly grew into something more, a modular Py
RTX 5090 random black screen + 100% fans + hard lock; sometimes no POST until AC power is removed — gaming, ComfyUI and Ollama I am looking for help diagnosing a very intermittent but increasingly fre
hey! we're a small swiss and south african lab and we just put out hemmingway-1. it's a 27b model we trained specifically for roleplay, creative writing, dialogue, stories, and for everyday texting. f
Since Ollama Cloud switched their plans to token-based pricing, did they start reporting cache read tokens, or their claim about 'transparency' was just PR? I was thinking about getting a subscription
full disclosure, i am the developer of locally uncensored :) i use ollama myself and honestly ollama was never really the problem. the problem was everything around it. one app for local chat, another
Okay, this one seems probably really odd (or maybe not), but most harnesses operate within token spaces. That is, every tool output, even batching of tool outputs, go back up into inference calls. Lea
Da un po mi sono ritrovato in garage un hp z840 da 64gb ddr5 montate (ora) e 2 processori con una gpu un po scarsina una nvidia quadro k680 (da aggiornare) avrei bisogno di un consiglio: quale modello
I’m one of the co-founders of NYX AI. It’s a Windows app that connects to local models through Ollama/lm studio or supported cloud providers, giving AI tools to work with documents, previews, spreadsh
The math don’t math. I’m paying way more on ollama for glm5.3 flash games Han I am on Openrouter. I made 153 requests for 47cents on Openrouter. On ollama it was 147 requests for $1.67. Math dont math
The goal of this post is 2 fold. First, I wanted to show what a local model like Qwen 3.8 27B running on a single RTX 5090 GPU in a harness like Row-Bot can do. Second, I wanted to create a full featu
I was wondering if there are any good coder models for 8GB VRAM RTX 5060. My specifications: 8GB RTX 5060 8GB DDR4 RAM 256 GB SSD I know the configuration is a bottleneck for sure. Though I don't have
So I know that Ollama is built on top of llama.cpp, I decided to run a model on both and applied settings on llama.cpp like flash attention and q8/q4 kv cache. On Ollama (using the Python package) I w
Vacations give you time to think and explore. I came across a few things and made a few discoveries of my own. It turns out that, as a programmer, I no longer need the smartest and most expensive AI m
Hi everyone, I’ve been experimenting with local LLMs on my 48 GB RAM MacBook Pro and I’m still trying to figure out what the best setup is. Ollama feels very fast, which I really like. The problem for
Hey everyone! I'm a beginner getting into local LLMs, and so far I'm familiar with Ollama. I've used it to download and run models locally, but I'm starting to see a lot of other tools being mentioned
https://www.curseforge.com/minecraft/mc-mods/verity-je Hi guys <3 What is the best performing ai agent that works with this mod? its called the verity mod. to be more general for anyone who doesnt kno
Salut, je cherche de l'aide pour un projet d'IA locale. J'ai un Dell OptiPlex 7070 Micro sous ubuntu server avec un i5-9500T, 32 Go de RAM et aucun GPU (j'en ajouterai un à l'avenir). Je sais que la m