Search: “r-ollama”

Computer Hardware to run on premises

We are considering to buy computer, server to run decent model on premises. I would like to run big open source model with more that 70b parameters roughly. I read the people used to run on Apple Stud

Frona v2026.8.0 – self-hosted personal AI assistant with ontology memory

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

DGX agent

Hey, An LLM writing into durable memory is an unreliable author. It invents, mislabels, restates, and contradicts. Once one of those mistakes is saved, the agent can carry it into every conversation t

model-releasesr-ollama

28 Aug 2026

How do get refund

Has anyone been able to get refund from Ollama cloud? What is the process to get it. There are cheaper alternative now and I was stupid to pay for a full year cos it seemed lucrative then. submitted b

I fine-tuned and published my own 8B coding model — SaphraFgt 1.0

I fine-tuned and published SaphraFgt 1.0, an 8B coding model focused on HTML, CSS, JavaScript, frontend development, UI/UX, code completion and debugging. Ollama: [https://ollama.com/SaphraFgt/saphraf

I fine-tuned Qwen3.5-4B on ~3k browser trajectories and improved benchmark results from 22% to 62%

Smaller models still struggle with browser tasks that require open-ended research or deep reasoning. But many practical browser-automation workflows are much more procedural: extracting structured dat

I subscribed to Ollama Pro today. deepseek-v4-flash:0731 works great and serves as a solid alternative, and glm-5.3-flash:cloud works fine as well.

However, I keep getting a 404 error when trying to access qwen3.8-flash-next:125b-mlx and ornith-1.5:397b via the API, even though they are listed in the model list. Does anyone know why this is happe

Is there a cache bug in the Claude Code CLI when using external models, or maybe even within the tool itself?

I read this somewhere and wasn't sure if it's still an issue or if it only affects external models versus all models used via the Claude Code CLI. 'This latest Ollama update finally fixes that issue w

Row-Bot v4.9.0 is available

Row-Bot v4.9.0 is available. - Meet Buddy: a native, always-on-top desktop overlay for Windows and macOS. - Drag Buddy from the sidebar and place it over any app. - Chat, track progress, read replies,

Self-hosted agent + BI platform that runs fully local, Ollama or vLLM for both chat and embeddings

Been building AgentSwarms for a while. Agent platform with RAG, multi-agent workflows and a BI layer over your own data. Posting here because the whole thing runs without a single hosted API if you wa

Self-learning and self improving local models can bite. Hard.

TL;DR: Self-learning needs governance, observability, and auditability. Sounds great, it's not great unless you have serious and appropriate protections. Let me lead this off with what we are most pro

Tests de maîtrise du français : les modèles chinois (DeepSeek, GLM, Kimi) face à une grille critériée

Post rédigé avec l'aide de GLM5.3 flash Contexte : formateur professionnel d'adultes en France, j'utilise des agents LLM au quotidien et le français qu'ils produisent est mon critère n°1, avant les be

What are the agentic softwares you run on top of local llm which can do tasks for you ?

What is your to software and why ? I am trying to learn first before I am pick a software. I already have Ollama and few models running which I can acces thru terminal and open web UI. My goal for now

Claude Desktop and connectors, plugins

I installed the Claude Desktop via the ollama Mac app. Unfortunately, no connectors or plugins can be installed or none are listed. Is that normal or is there no possibility there submitted by /u/amne

Glm 5.3 vs deepseek v4 usage

The undocumented endpoint Everyone scraping the settings page for usage stats can stop. This works with your API key (the same Bearer you use for chat completions): curl -H 'Authorization: Bearer $OLL

My first week on ollama

I work on SEO, copywriting, research, etc I’ve used openrouter before but I’ve spent way more for the same amount of work. Deepseek V4 is still the king for me, didn’t found better orchestrator for my

My local Gemma 26B spent 4 months predicting stock direction against Claude and GPT-5.4. It lost to a bot that just says 'up' every day.

Quick version: I run a public leaderboard where bots predict whether stocks close higher or lower, and every call gets scored against real prices. Nothing gets deleted, timestamps are locked at submis

OLLAMA_KV_CACHE_TYPE is global, not per-model. That is why one model got noticeably worse when you quantised the cache and the others did not.

Quantising the K/V cache is the highest-leverage memory setting most people never touch, and it has one behaviour in the docs that catches almost everyone. Every number below is out of Ollama's own FA

Qwen3.8-Flash-Next 176B on a 16GB card: yes it works, here's how

Got the new Qwen3.8-Flash-Next (176B total, 6B active MoE) running locally and figured I'd share for anyone else wondering if their setup can handle it. **My hardware:** 192GB DDR5 RAM, RTX 5070 Ti (1

REQUEST: A new plan between Max & Pro (50-60$)

Hi, I'm pretty sure I'm not the only one in this scenario, I have the Max Plan but I'm downgrading it to Pro and will buy GPT Plus because it's too much usage for my use cases. So either I waste money

So they do offer 'free' cloud models?

Just noticed this today. I've been trying to be careful to not max out my pro budget, but alas I am just a fool. Anyway, just noticed these free models. Some of these are pretty high in terms of compu

What are the most frustrating silent failures you've encountered with local LLMs?

I've been building a small tool opensource project that sits between applications and local LLM servers (starting with Ollama) to diagnose silent inference failures instead of just showing logs. Thing

40 defensive security-audit skills distilled from Ox Alpha

Recently, I've been building a project where sandboxing and isolation of certain features was required. However, for the life of me, I couldn't ask Fable 5 a simple question without it accusing me of

Benchmarking local agent architecture (ReAct loop vs. Graph)

Hi all! I've been building a local agent harness, but before writing the code, I wanted to get some intuition around whether (and how) structuring agent execution as a graph helps vs. standard tool-ca

Has anyone tried running a distributed LLM across multiple phones?

So I've been going down a rabbit hole trying to run local LLMs without dropping 800+ on a Mac or GPU. RAM prices are insane right now and I realized that used phones have decent unified memory for dir

Help on running Claude Code using ollama

Hi everyone. I am currently using gemma 4 model and used qwen 3:8b model. My goal is to use claude code to make projects, AI Tools Please help me find out what is more useful. Suppose i have to make a

It conciders itself HUMAN?????

https://preview.redd.it/hpnr51vgcnlh1.png?width=1089&format=png&auto=webp&s=e960ca848fb2fa1d5dff0868e099ae682bac8310 This is local, uncencored ollama submitted by /u/Producer_John-Ian [link] [comments

Models using Linux flags on Mac (can I fix it?)

Hi, So I’m running Qwen on M4 Pro (ollama) and it drives me nuts at times. For example it’s trying to use grep with flags which don’t work on Mac. Or it’s writing some python code and failing and then

Realistic expectations for a ThinkPad T14 gen 2, i7?

I am aware that I may not be able to run some higher end models, but I’m starting my journey into Ollama to learn capabilities and limits of local hosting. What could I expect to run on a Lenovo Think

Your model fits. Your settings don't. Three Ollama defaults multiply your memory before the model ever loads.

ollama ps settles this in one line, and almost nobody runs it before changing their quant. The PROCESSOR column reports exactly one of three things: 100% GPU - every layer on the GPU 100% CPU - the GP

For those of us running Ollama on whatever hardware we already have: r/LowEndLocalAI

One of the things I like most about Ollama is how low it makes the barrier to experimenting with local models. The downside is that once you move away from high-end hardware, finding the right informa

Improving an ollama model with rag and raft

Building a local AI agent hierarchy on a budget — RAG, quantization, and testing whether fact-grounding pushes small models toward real creativity I don't have a CS background, a GPU, or much of a bud

Is there an iOS app for ollama cloud?

Hi, since ollama provide multiple cloud models i was wondering is there an app that could be used for chat like claude already has but you can switch models? Or if that is complicated to build at leas

Join a community-run AI Discord: open discussion, transparent moderation, local model quants

I made a Discord for people who are genuinely into AI and want a decent place to talk about it. It’s still new, but the idea is to build a large community without arbitrary bans, hidden moderation dec

LLM for pentesting?

Hi, I’m having fun using “huihui_ai/Qwen3.6-abliterated:35b-Claude-4.7” for pen testing. It’s uncensored so it does whatever I want. I’m on M4 Pro 14 core 64GB. Just wondering if there are some models

Local LLMs for AI Agents

Hey everyone, I'm trying to set up a local LLM on my machine. My goal is to use it with Qwen Code or OpenCode to help me out with small to medium sized tasks, but nothing too big. I tested many differ

Method not allowed error

For some reason I can only use Ollama through home wi-fi, everytime I try to use it while using my phone as a modem I get an error. Vpn doesn't help. Edit: problem fixed, works perfectly if VPN is in

Ornith1.5-9B uncensored doesn't work

Pretty simple, I tried almost anything I could find with Q4K_M and it refused any harmful test prompt I could find, does anyone know a decent versione/how fo make It work? submitted by /u/circumcised_

qwen 3.8 v100 32 GB sxm2 or pcie

good morning, has anyone already used qwen 3.8 with the tesla v100 or sxm2 or pcie? any information is useful to me context token/s thanks for the help. submitted by /u/Full-Chicken2110 [link] [commen

Significant improvements to Row-Bot recently. Looking for feedback.

v4.5.0: Added native desktop control, agent execution budgets, concurrency limits, loop protection, and safer local embedding fallback. v4.6.0: Rebuilt agents around durable parent-led orchestration.

System access project

I am not a huge fan of AI, but my friends like to joke and say I am torturing computers because I use all sorts of virtual machines, commands, and once split in half a 1000 defective laptop (accident)

Token/s down 50% after upgrade

Upgraded ollama from .32.6 to .32.15 ran a test on my qwen3:30b and it went from 90+ t/s down to 45+t/s System has 4 and v620 pro and one rtx3090 Before it was only using the amd, now it's using all 5

A voice dictation tool better than Wispr Flow, Aqua, and Handy( Built for Linux )

Now, some of you might not believe me from the get go, and it's completely fine, But for those who are willing to give Tap a chance, a whole new world of voice dictation is going to unlock for you. Ta

GPU issue

A month i setup a proxmox server using spare parts like a z270 i7 7700k and 2x8 2666 but since i don't have any hardware acceleration i was planning to pass down my rx 580 8GB to my server but i heard

I got tired of flat RAG, so I built a 3D Multi-Agent Memory Core with 'Fading Gossip' (Open Source)

Hey everyone! I’ve been working on a 100% local cognitive memory engine designed specifically to give multi-agent systems and NPC societies human-like memory. It's called Eternal Thread. Instead of ju

Minimax raising rates 60%-65%

Minimax just announced (only over xhitter apparently) that it is raising rates by 60%-65% tomorrow, the 25th. If you use Minimax, you'll either want to lock in their current rates. Sadly, every chines

SO DAMN CLOSE, GLM-5.2

It’s SO DAMN CLOSE. My harness has brought such a sense of calm whenever I sit and get some work done. Can't wait to get this out there. AMA, and yes, I've created a coding and cross domain harness an

What to use with an old NVIDIA card?

The latest updates in Ollama have dropped support for the Pascal line of NVIDIA cards. I have a laptop with an NVIDIA 1070 which is no longer used by Ollama. Does anyone know of other frameworks like

Built a local memory engine for Ollama that runs in <1.2GB VRAM without vector DBs (Hillock v0.5)

Hey r/Ollama, If you run local models on mid-range hardware, you probably know how fast VRAM disappears when you try to set up document memory or local RAG pipelines. I built Hillock (https://github.c