Search: “r-ollama”

I'm tired of watching my compute budget and topping off my Ollama account. It feels like I can use a mix with more flash models on Openrouter (things not all available at Ollama) and control my spend

Ollama’s new limits and max plans are worrying me, so I’ve been going harder on my harness. (Thanks to everyone who’s signed up for the waitlist so far.) Wanted to share how my v1.10.0 will dramatical

Apple Foundation Model 3 through Private Cloud Compute is directly available in macOS 27.2 through familiar AI clients. For Mac users running local models such as Qwen 3.x or Gemma 4, AFM 3 PCC is a c

Processor Intel(R) Core(TM) Ultra 5 226V (2.10 GHz) Installed RAM 16.0 GB (15.7 GB usable) Graphics card Intel(R) Arc(TM) 130V GPU (8GB) (128 MB) Storage 273 GB of 954 GB used System type 64-bit opera

Hi, I’m using Qwen3.8 27B in my vulnerability scanner, it does scan JS files, tries to generate exploits etc. I’m using uncensored version, the model is like 21GB. Running it on Mac M4 Pro 64GB ram, i

I wanted a fun way to visualize and stress-test a multi-agent ecosystem, so I pointed it at my favorite MMO (a vanilla-era private server emulator). Live view: https://design.kristiantalley.com/projec

Hi, I'm a long time subscriber of their pro plan. In the past, they were adding the open weight models to their catalog as soon as they dropped. Since this new change in their payment plans, I haven't

https://preview.redd.it/2fvmzd4f3ish1.png?width=952&format=png&auto=webp&s=d21e33fd26b46d2268a12219d8c0619666eb000e I thought something was off because browser_search was taking almost a minute for a

This keeps happening and has been happening for over a month now. Since ollama has zero support I'm hoping someone else has figured out a work around for the issue. I'm using the latest version of ope

A while back I posted here about a CLI agent I'm building that parses tool calls out of a model's plain-text output instead of trusting native function-calling to work. Finally ran the actual numbers.

I recently started using my Mac Mini M4 as an always-on home server. It stays powered on most of the time, and right now I’m running my Discord bot on it. I’m thinking of gradually turning it into my

Hey r/ollama ! I'm Roy, solo dev of Observer. Observer is a free open-source agent that uses small local LLMs to monitor your screen, so you don't have to. This is the demo of the agent that controls

I maintain a starter kit where the LLM provider is a runtime-swappable DB row, not a hardcoded constant — OpenAI, Anthropic, or a local Ollama instance. Mostly so I can demo without burning API credit

We’ve released the complete VeriLoop E2 GGUF precision ladder, from the canonical BF16 reference down to a mixed-precision IQ1_M deployment tier. This post is specifically about the GGUF release and l

I run a personal always-on agent fleet — eight seats claiming work in parallel from a shared task board, routing across Anthropic, OpenAI, xAI, Google, and a local Ollama floor. This week the spend fo

​ Hi. I’m developing my first Python project (been at it a couple weeks). I built a very basic CLI ollama client. When a user sends a prompt I append the message to session['history'], save the sessio

Hi - I want to build a home server for Ollama. I want to connect to the server via my laptop and mobile devices to do research and run agents. What is recommended to get this going ? submitted by /u/R

Built this because I got tired of guessing whether a model would fit in my 6GB VRAM before downloading it, and because ollama.com's library doesn't let you sort by size. What it does: - Benchmarks Oll

Hey r/Ollama, I've been working on Presentation Forge, an open-source presentation/report generator that supports Ollama for local inference. I originally made it because I'm a university student and

Hey everyone, A major issue when building test environments or fine-tuning pipelines is balancing data realism with privacy. Pasting real internal/client data into cloud endpoints is a massive complia

I was having trouble searching and analyzing the different models that Ollama has available ( https://ollama.com/library ). I wanted to filter for specific model sizes and tooling capabilities, so I b

I’ve been experimenting with local AI lately, and one thing I’m finding interesting is what comes after getting a model running. Ollama makes local model access pretty straightforward, but for an actu

Guys I have a M4-mac air with 24 GB unified memory and I wanna run some local LLM model on my machine Currently I am working on building and RAG application which is mostly and QnA system but I wanna

I'm in a position where I didn't mean to go down this AI rabbit hole... I was looking into mental cognitions and how the mind is made up and learned that my old RTX 5k could run small models. So that

Context: we build an open-source (MIT) self-hosted database client and added a natural-language-to-SQL assistant that can point at a local runtime like Ollama instead of a hosted API. I want to share

Been building some multi-agent pipelines recently and the degradation in direct execution is insane. Whenever I pass a strict operational variable or hypothesis, the LLM triggers this 'Devil's Advocat

I am creating a local AI agent called 'Ontelic' for Windows. Ontelic returns to Ollama and also manipulates the actual Chrome. This is not for promotion but to share what we've learned. I'll give GitH

Yep. I just need tips honestly on UI layouts and how to build my shell for the local api offline. I’m using qwen and ollama and just want a simple discord style interface to declutter my brain to like

In light of recent events and media coverage, ai is in the spotlight and people are afraid. How I respond to those fears: If you are afraid of ai then you should also be afraid of all medical research

Is it just me or ollama serve command doesn't work at all. It uses a different directory than the systemd process, so it can't find any model or anything if you installed it using systemd ollama. Luck

Hey everyone, I made a simple script called MOMOS to run Ollama and small LLMs directly on your Android phone using Termux. It automatically handles PRoot-Distro (Debian), installs Ollama, and lets yo

Saw a new open 27B model release that looks like it could be interesting for the Ollama crowd: VeriLoop E2. It is a Qwen3.8-27B post-train aimed at code, mathematics, scientific reasoning, and agentic

Hey everyone, I’m new to running AI models locally and I’d like some advice. My laptop specs are: HP OMEN 15 CPU: Intel i5-8300H RAM: 16 GB GPU: NVIDIA GTX 1050 Ti 4 GB VRAM OS: Windows I’m planning t

Hey everyone, I'm getting into running LLMs locally with Ollama and would like some recommendations on which models I should realistically run with my hardware. My PC specs GPU: RTX 5060 Ti 16GB VRAM

I've been comparing and working on Gemma 4, Phi-4-Mini, and Qwen3-4B for local LLM use on an 8 GB Raspberry Pi 5. The results were indeed close, but each model has a different strength: Gemma 4 E2B: a

I keep trying to get it to write code and test simpel stuff but it never finsihes conversation its always stopping mid way. i installed it through qwen > ollama. currently removed it and trying to rei

Hi everyone, I wanted to ask you a question. I’m developing an app, and I’m currently putting together a list of the best AI models, especially, but not necessarily, in GGUF format and using Q4_K_M qu

So I'm using zcode and I'm not sure how to use ollama with it, it has a custom provider section https://preview.redd.it/uqomt844o0rh1.png?width=588&format=png&auto=webp&s=6cd21050f9f9c94d720205f9a4a03

🚀 THE EDGE AI FAMILY HAS ARRIVED. Today we’re opening the doors to a new generation of open-source and open-weight edge AI models from Next GenAi. Meet Rebekah AI 1.8B. 🧠⚡ Small enough to run at the e

I'm working on a computer game as a side project. I started it around 4 years ago, before I used any AI for coding. For most of that time I wrote everything myself. Later I started using GitHub Copilo

I tried putting up with it the last week or two but it's become unusable. I've tried GLM 5.3 & 5.3 Flash, GLM 5.2, and Deepseek V4.1 The inference and pp speeds have become unbelievably slow, I just c

Hey everyone, A few classmates and I got tired of the usual browser AI workflow: copying text from a documentation page, opening a separate tab, pasting it into a chatbot, and switching back. We also

I've been building an open-source AI workflow automation platform for a while now, mostly as a solo project. I recently checked the telemetry dashboard and was honestly surprised to see 1,062 telemetr

I’m building a personal local coding-agent project called Cody, using local 9B/14B models through Ollama. This is still a work in progress. It has not passed its full graduation process yet, and the l

A few days ago, I came across a post/comment saying that you can get better data privacy by using local Ollama models in a RAG pipeline instead of relying on cloud-hosted models/APIs. The explanation

been working on this thing called OpenComms for a bit. basically i keep multiple coding agents open at once, usually stuff like a lead, builder, reviewer etc, and i got sick of copying messages betwee