Search: “r-ollama”

Are frontier models actually becoming less important?

I’m genuinely mind-blown by what’s happening with AI models right now. On one side, you have GPT-6-class frontier models that are just… insane. The level of capability is getting hard to wrap your hea

11 Sept 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Best Local Models for Claude Code with 8gb vram

DGX agent

Tested on Laptop with RTX 5060 8gb vram and 16gb ram Claude code - autocompact = false Ollama - Flash attention = 1, kv cache = q8_0 Gemma4 12B 64K - https://ollama.com/SetneufPT/Gemma4-12B-IT-QAT_Q4_

model-releasesr-ollama

11 Sept 2026

Detecting hallucinations in local models without eating VRAM: What we learned testing 1.5B to 120B models

Hey everyone, If you run local models via Ollama in production or personal projects, you've probably run into the hallucination problem: how do you know when a model is hallucinating without burning e

11 Sept 2026

Thank you, Ollama. DeepSeek v4.1 Flash is the best.

That's amazing. I've been using the pay-as-you-go plan, and because DeepSeek 4 Flash wasn't great, I was using GLM 5.3 Flash instead. But now that I'm using the high-performing DeepSeek 4.1 Flash, the

11 Sept 2026

Help - Symbols not displaying correctly

https://preview.redd.it/4c6otbeg1qoh1.png?width=1139&format=png&auto=webp&s=2d127bd3bc83d5e6ba65c3a4bd909529f34e9a3c Total beginner here, i've just downloaded Ollama and Gemma4:26b, but when it answer

I'm rooting for Ollama to find a new angle

First off, I'm super thankful for the value Ollama has given me Got me setup with my first local LLM setup (early OpenClaw days amirite!?) Then got me into their 20 plan and what really sold me here w

My agent kept randomly stopping mid-task and I finally figured out why (llama.cpp + Qwen3 tool calling)

Spent about two weeks convinced I had a prompting problem. My local Qwen3 agent would just stop. No error, no crash, finish_reason came back as 'stop' like the model had decided it was done. Except it

new rate limits for old subscribers

are very strict... if 20 calls to kimi are more than my 5 hour limit why even bother? im gonna cancel my sub for sure https://preview.redd.it/gbqkci93gnoh1.png?width=1080&format=png&auto=webp&s=6fac5a

VLLM-MLX vs Ollama MLX... Ran concurrency benching. Qwen3.5-4B.

Anyone else play with vllm-mlx? There was an interesting paper that came out that compared this version of vllm that was originally designed for multi modal inference performance gains, but ended up s

college student replicates claude cowork for open source models

In july I posted here about aletha codex and I got a lot of support, and a decent amount of people started using it. I also got a lot of criticism too, which really helped me funnel this version 1.5 t

Does ollama phone home?

im new to using ai so i may be missing something. I set up ollama but dont want any of my data to go to any of the model providers, for certain models i appear to need an api key to download the model

Exploring a side question without losing the original conversation

I shared ThoughtDAG here a while ago. I've now recorded how I use it: select a phrase in an answer, explore it on a branch, and connect the parts I want in the next question. I'm the developer. Though

Having trouble with models just cutting off suddenly when responding.

I'm using two different models. One Gemma 4 and the other qwen 3.5. Both of them are responding to my input either by silence ('thought for a moment.... then nothing') or nonsense: <|turn>user <|turn>

I made a short explanation of KV Cache — is this understandable for beginners?

I’ve been experimenting with explaining AI/LLM concepts in a way that doesn’t assume too much technical background. This video is about KV Cache and why longer context windows require more memory duri

multi-agent conversations with Ollama on Windows

I was curious about how AIs talk to each other and how a conversation changes as it goes on, so I built AI Arena Lite. It connects to Ollama and lets you assign models to different agent roles, follow

raggy - CLI tool for RAG over your local documents built with Ollama

https://github.com/paulknysh/raggy A lightweight CLI tool for Retrieval-Augmented Generation (RAG) over local documents built with Ollama. Hybrid database (vector + BM25 index) and embedding generatio

Run Claude Code on Ollama models with per-model context scaling and cost tracking

I've been running Claude Code as my daily driver and wanted Ollama models in the loop without giving up the harness. So I built gremlord, a small Go binary that points the unmodified claude binary at

The new subscription model is bad.. really bad

Hi, I have the biggest pro subscription.. had it for months.. been using more or less the same models (GLM 5.x) - i would averagely be at 95% on a sunday.. and it would renew at Monday. Now we are att

What's with ollama and the blobs?

I only just found ollama, but I ran into a problem described in this conversation from years back: https://www.reddit.com/r/ollama/s/YZ88XkHmIS Has nothing changed? The storage seems a mess. I had to

CONFIRMED: Ollama Cloud nerfing usage limits on grandfathered Pro/Max Plans

Confirmed by my weekly Hermes analytics. Estimated at roughly 50% cut in weekly and session limits. Which cloud inference plans are you all migrating to? (I understand that local inference is preferre

I built a thing that benchmarks Ollama models on your own hardware and ranks them

I kept picking local models badly. Parameter count, quantization, VRAM. I could read all of it and still not know whether a model would be any good on my machine. So I stopped guessing and wrote somet

Local dictation for Windows: hold right Ctrl, speak, let go - Ollama does the clean-up

Hold right Ctrl, speak, release. faster-whisper (large-v3-turbo) transcribes on your own GPU, then qwen2.5:3b-instruct through Ollama cleans the text up: filler words out, punctuation in, spoken self-

Locus - A MacOS tool for Ollama and other local models

Hey so a few months ago I got into local LLMs and didn’t really like the tools out there at the time, so I decided to build my own version of a Claude/Codex GUI for local models. I’ve been working on

Ollama serve command doesn't work with python

I was thinking about using WebUI but I have a big problem with ollama serve command. Basically I made a python script that uses Ollama API and it works damn well if I don't serve the Ollama server man

ollama serve required after changing OLLAMA_MODELS directory

Hi everyone, This is probably a simple problem, but I can't get my head around it. I am running ollama 0.33.3 on Linux Mint Cinnamon 21.3 with separate partitions for root and home. The standard insta

Using Claude Code with Ollama and Desperately require caching!

Ok I know I'm likely to get steamrolled here but I also have a sense of optimism and hope I can get some sort of answer that will be beneficial. We all know since the new price structure, usage has sh

Which local models handle structured extraction well? I moved my agent's memory into a folder (BYO model) and want to run it on Ollama instead of Sonnet

Setup, so the question makes sense: my coding agent's memory now lives in a folder of Markdown — entities, episodes, and procedures (workflows with a per-step success/fail record). Nothing needs an ac

Qwen 3.8 27B run just 0.7tok/s on 5060ti 16GB

I just tried to run Qwen 3.8 27B 4bit qwant on 5060ti 16GB and got terrible results. With Qwen 3.6 I got something around 15-20 tok/s. Are there any combination of parameters or tweeks how to push the

7 Sept 2026

Qwen3.8-27B on M1 Max 32GB: MLX 15.8 tok/s vs llama.cpp 9.7 tok/s - but llama.cpp prefill is faster

I’ve been setting up an M1 Max Mac Studio (24-core GPU, 32GB unified memory) as a local LLM server and wanted to compare MLX vs llama.cpp on Qwen3.8-27B. I tried to keep the model footprint and benchm

7 Sept 2026

Skipping skills! First class tools... GLM-5.2

Claude Code is absolutely horrendous at managing docx XML structures and it's obscene that the best these frontier companies can do are skills. Skills are prone to breaking, burn tokens (hello busines

4 Sept 2026

Best small LLMs for translations?

I am working with multi-language content and have so far been useing gemma4:e2b for general work. Today I tried it with Russian for the first time and the result was not great. Gemma4:e4b was better,

I do not wish for Nvidia to have a majority stake in Hugging face.

I like Nvidia, Ollama, and Hugging Face. I wish each of them well. But one owning the other creates a huge conflict of interest. Separation of Powers is key for long term sustainability of open weight

Looking for Captain Obvious

I might be missing something obvious, but when I open any cloud model, by default I'm dealing with the 200k version and the first thing I need to do is /model to change it to the 1M version. Is there

New ollama plan usage

Bruh wtf, i switched to new method now im pissed, 20 dollars a month for 60 api cost a month ?? Open code provides this for 10 dollars a month , and if I use a beast like kimi k3 I can drown my months

Ollama Pro is 20, but the new '60 credits' are more like $7-8 elsewhere

Everyone is talking about how the new credit system gives significantly less usage than the old Ollama Pro limits, but there's another part of the pricing that seems a bit crazy to me. For example, I

Openvurp: a wallet of agents that work together

I have a few AI subscriptions and I kept running into the same problem. I had powerful models available, but I struggled to use them in real life in an organized way. I looked at projects like OpenCla

I'm free! No babysitting for me... GLM-5.2

I've said this in another post, but again started with Claude Code, loved OpenCode, but I felt chained and tied to them both for the longest time (especially CC, just the worst). I felt less productiv

Old Pro plan isn't the same anymore

I'm still with the old pro plan, and I've never (almost) reached my weekly limit so fast like today with that many requests and using OpenClaw for pretty basic stuff. There is some serious monkey busi

PSA: If you’re on the old Ollama Pro plan, don’t switch - ~67% LESS usage

Ollama has just announced, based on 'feedback', that they have switched to a credit model. If you're still on the old 20 Pro compute plan, DON'T SWITCH. I decided to calculate it before I risked click

Value analysis of the old Ollama Pro sub model vs the new per-token model (from 50 days of real usage)

Why I have this data: one Pro account kept hitting limits, so I run three Pro subs through 9router, a self-hosted router that sits between my coding tools and ollama cloud. It spreads requests across

Will this server hardware work?

Years ago I built a server, shelved it after some time, but recently realized I have it sitting there. I'm looking to pop in a Tesla V100 32GB card (with proper cooling). But are the component too old

AutoGPT from source with local models: complete setup guide

I put together a technical guide for installing AutoGPT from source, with a focus on using local models instead of OpenAI. It includes Docker Compose files, environment variables, and how to point the

Harness added OpenCode Go, Codex... In one shot. GLM-5.2.

I absolutely love Ollama for the majority of my inference needs. Starting to roll out Rehex to friends, and I've gotten requests to support OpenCode Go and Codex. Frankly, I'm really excited to add th

Made an Ollama GUI where the Modelfile editor sits next to the chat

I kept running into the same thing. Change a system prompt, get a different answer, and I couldn't tell if that was my change or just the sampler. The loop made it worse. Edit the Modelfile in another

Minimax M3 no longer free on Ollama Cloud

Just FYI. They removed it. Free models that can be used with Ollama Cloud now: gemma4:31b gpt-oss:120b gpt-oss:20b nemotron-3-nano:30b nemotron-3-super nemotron-3-ultra submitted by /u/IndividualPlus2

OpenCode, OpenRouter, and Ollama all went to shit at the exact same second. I don’t believe in coincidences anymore.

happened simultaneously across the board. OpenCode, OpenRouter, and Ollama all ruined DeepSeek at the exact same moment. They literally turned a brilliant model into a complete idiot overnight. I abso

TestFlight Testers Needed! PowerChat – an AI chat client with RAG, MCP

Hi r/ollama! I am the solo dev of PowerChat, an AI chat client that provides a mobile chat interface for iOS (iPhones for now, iPad and Mac planned) to connect to self-hosted models using Ollama, or O

UPS Fuse Exploded While Running an LLM

I was running Ollama with Maxwell 1500, using a 65,536-token context window, through Zoo Code inside VS Code. I asked the model to analyze a folder containing some pretty simple code. It spent around