I'm free! No babysitting for me... GLM-5.2
I've said this in another post, but again started with Claude Code, loved OpenCode, but I felt chained and tied to them both for the longest time (especially CC, just the worst). I felt less productiv
Knowledge catalogue
I've said this in another post, but again started with Claude Code, loved OpenCode, but I felt chained and tied to them both for the longest time (especially CC, just the worst). I felt less productiv
I'm still with the old pro plan, and I've never (almost) reached my weekly limit so fast like today with that many requests and using OpenClaw for pretty basic stuff. There is some serious monkey busi
Ollama has just announced, based on 'feedback', that they have switched to a credit model. If you're still on the old 20 Pro compute plan, DON'T SWITCH. I decided to calculate it before I risked click
Why I have this data: one Pro account kept hitting limits, so I run three Pro subs through 9router, a self-hosted router that sits between my coding tools and ollama cloud. It spreads requests across
Years ago I built a server, shelved it after some time, but recently realized I have it sitting there. I'm looking to pop in a Tesla V100 32GB card (with proper cooling). But are the component too old
I put together a technical guide for installing AutoGPT from source, with a focus on using local models instead of OpenAI. It includes Docker Compose files, environment variables, and how to point the
I absolutely love Ollama for the majority of my inference needs. Starting to roll out Rehex to friends, and I've gotten requests to support OpenCode Go and Codex. Frankly, I'm really excited to add th
I kept running into the same thing. Change a system prompt, get a different answer, and I couldn't tell if that was my change or just the sampler. The loop made it worse. Edit the Modelfile in another
Just FYI. They removed it. Free models that can be used with Ollama Cloud now: gemma4:31b gpt-oss:120b gpt-oss:20b nemotron-3-nano:30b nemotron-3-super nemotron-3-ultra submitted by /u/IndividualPlus2
happened simultaneously across the board. OpenCode, OpenRouter, and Ollama all ruined DeepSeek at the exact same moment. They literally turned a brilliant model into a complete idiot overnight. I abso
Hi r/ollama! I am the solo dev of PowerChat, an AI chat client that provides a mobile chat interface for iOS (iPhones for now, iPad and Mac planned) to connect to self-hosted models using Ollama, or O
I was running Ollama with Maxwell 1500, using a 65,536-token context window, through Zoo Code inside VS Code. I asked the model to analyze a folder containing some pretty simple code. It spent around
We are considering to buy computer, server to run decent model on premises. I would like to run big open source model with more that 70b parameters roughly. I read the people used to run on Apple Stud
Hey, An LLM writing into durable memory is an unreliable author. It invents, mislabels, restates, and contradicts. Once one of those mistakes is saved, the agent can carry it into every conversation t
Has anyone been able to get refund from Ollama cloud? What is the process to get it. There are cheaper alternative now and I was stupid to pay for a full year cos it seemed lucrative then. submitted b
I fine-tuned and published SaphraFgt 1.0, an 8B coding model focused on HTML, CSS, JavaScript, frontend development, UI/UX, code completion and debugging. Ollama: [https://ollama.com/SaphraFgt/saphraf
Smaller models still struggle with browser tasks that require open-ended research or deep reasoning. But many practical browser-automation workflows are much more procedural: extracting structured dat
However, I keep getting a 404 error when trying to access qwen3.8-flash-next:125b-mlx and ornith-1.5:397b via the API, even though they are listed in the model list. Does anyone know why this is happe
I read this somewhere and wasn't sure if it's still an issue or if it only affects external models versus all models used via the Claude Code CLI. 'This latest Ollama update finally fixes that issue w
Row-Bot v4.9.0 is available. - Meet Buddy: a native, always-on-top desktop overlay for Windows and macOS. - Drag Buddy from the sidebar and place it over any app. - Chat, track progress, read replies,
Been building AgentSwarms for a while. Agent platform with RAG, multi-agent workflows and a BI layer over your own data. Posting here because the whole thing runs without a single hosted API if you wa
TL;DR: Self-learning needs governance, observability, and auditability. Sounds great, it's not great unless you have serious and appropriate protections. Let me lead this off with what we are most pro
Post rédigé avec l'aide de GLM5.3 flash Contexte : formateur professionnel d'adultes en France, j'utilise des agents LLM au quotidien et le français qu'ils produisent est mon critère n°1, avant les be
What is your to software and why ? I am trying to learn first before I am pick a software. I already have Ollama and few models running which I can acces thru terminal and open web UI. My goal for now
I installed the Claude Desktop via the ollama Mac app. Unfortunately, no connectors or plugins can be installed or none are listed. Is that normal or is there no possibility there submitted by /u/amne
The undocumented endpoint Everyone scraping the settings page for usage stats can stop. This works with your API key (the same Bearer you use for chat completions): curl -H 'Authorization: Bearer $OLL
I work on SEO, copywriting, research, etc I’ve used openrouter before but I’ve spent way more for the same amount of work. Deepseek V4 is still the king for me, didn’t found better orchestrator for my
Quick version: I run a public leaderboard where bots predict whether stocks close higher or lower, and every call gets scored against real prices. Nothing gets deleted, timestamps are locked at submis
Quantising the K/V cache is the highest-leverage memory setting most people never touch, and it has one behaviour in the docs that catches almost everyone. Every number below is out of Ollama's own FA
Got the new Qwen3.8-Flash-Next (176B total, 6B active MoE) running locally and figured I'd share for anyone else wondering if their setup can handle it. **My hardware:** 192GB DDR5 RAM, RTX 5070 Ti (1
Hi, I'm pretty sure I'm not the only one in this scenario, I have the Max Plan but I'm downgrading it to Pro and will buy GPT Plus because it's too much usage for my use cases. So either I waste money
Just noticed this today. I've been trying to be careful to not max out my pro budget, but alas I am just a fool. Anyway, just noticed these free models. Some of these are pretty high in terms of compu
I've been building a small tool opensource project that sits between applications and local LLM servers (starting with Ollama) to diagnose silent inference failures instead of just showing logs. Thing
Recently, I've been building a project where sandboxing and isolation of certain features was required. However, for the life of me, I couldn't ask Fable 5 a simple question without it accusing me of
Hi all! I've been building a local agent harness, but before writing the code, I wanted to get some intuition around whether (and how) structuring agent execution as a graph helps vs. standard tool-ca
So I've been going down a rabbit hole trying to run local LLMs without dropping 800+ on a Mac or GPU. RAM prices are insane right now and I realized that used phones have decent unified memory for dir
Hi everyone. I am currently using gemma 4 model and used qwen 3:8b model. My goal is to use claude code to make projects, AI Tools Please help me find out what is more useful. Suppose i have to make a
https://preview.redd.it/hpnr51vgcnlh1.png?width=1089&format=png&auto=webp&s=e960ca848fb2fa1d5dff0868e099ae682bac8310 This is local, uncencored ollama submitted by /u/Producer_John-Ian [link] [comments
Hi, So I’m running Qwen on M4 Pro (ollama) and it drives me nuts at times. For example it’s trying to use grep with flags which don’t work on Mac. Or it’s writing some python code and failing and then
I am aware that I may not be able to run some higher end models, but I’m starting my journey into Ollama to learn capabilities and limits of local hosting. What could I expect to run on a Lenovo Think
ollama ps settles this in one line, and almost nobody runs it before changing their quant. The PROCESSOR column reports exactly one of three things: 100% GPU - every layer on the GPU 100% CPU - the GP
One of the things I like most about Ollama is how low it makes the barrier to experimenting with local models. The downside is that once you move away from high-end hardware, finding the right informa
Building a local AI agent hierarchy on a budget — RAG, quantization, and testing whether fact-grounding pushes small models toward real creativity I don't have a CS background, a GPU, or much of a bud
Hi, since ollama provide multiple cloud models i was wondering is there an app that could be used for chat like claude already has but you can switch models? Or if that is complicated to build at leas
I made a Discord for people who are genuinely into AI and want a decent place to talk about it. It’s still new, but the idea is to build a large community without arbitrary bans, hidden moderation dec
Hi, I’m having fun using “huihui_ai/Qwen3.6-abliterated:35b-Claude-4.7” for pen testing. It’s uncensored so it does whatever I want. I’m on M4 Pro 14 core 64GB. Just wondering if there are some models
Hey everyone, I'm trying to set up a local LLM on my machine. My goal is to use it with Qwen Code or OpenCode to help me out with small to medium sized tasks, but nothing too big. I tested many differ
For some reason I can only use Ollama through home wi-fi, everytime I try to use it while using my phone as a modem I get an error. Vpn doesn't help. Edit: problem fixed, works perfectly if VPN is in
Pretty simple, I tried almost anything I could find with Q4K_M and it refused any harmful test prompt I could find, does anyone know a decent versione/how fo make It work? submitted by /u/circumcised_
good morning, has anyone already used qwen 3.8 with the tesla v100 or sxm2 or pcie? any information is useful to me context token/s thanks for the help. submitted by /u/Full-Chicken2110 [link] [commen
v4.5.0: Added native desktop control, agent execution budgets, concurrency limits, loop protection, and safer local embedding fallback. v4.6.0: Rebuilt agents around durable parent-led orchestration.
I am not a huge fan of AI, but my friends like to joke and say I am torturing computers because I use all sorts of virtual machines, commands, and once split in half a 1000 defective laptop (accident)
Upgraded ollama from .32.6 to .32.15 ran a test on my qwen3:30b and it went from 90+ t/s down to 45+t/s System has 4 and v620 pro and one rtx3090 Before it was only using the amd, now it's using all 5
Now, some of you might not believe me from the get go, and it's completely fine, But for those who are willing to give Tap a chance, a whole new world of voice dictation is going to unlock for you. Ta
A month i setup a proxmox server using spare parts like a z270 i7 7700k and 2x8 2666 but since i don't have any hardware acceleration i was planning to pass down my rx 580 8GB to my server but i heard
Hey everyone! I’ve been working on a 100% local cognitive memory engine designed specifically to give multi-agent systems and NPC societies human-like memory. It's called Eternal Thread. Instead of ju
Minimax just announced (only over xhitter apparently) that it is raising rates by 60%-65% tomorrow, the 25th. If you use Minimax, you'll either want to lock in their current rates. Sadly, every chines
It’s SO DAMN CLOSE. My harness has brought such a sense of calm whenever I sit and get some work done. Can't wait to get this out there. AMA, and yes, I've created a coding and cross domain harness an
The latest updates in Ollama have dropped support for the Pascal line of NVIDIA cards. I have a laptop with an NVIDIA 1070 which is no longer used by Ollama. Does anyone know of other frameworks like
Hey r/Ollama, If you run local models on mid-range hardware, you probably know how fast VRAM disappears when you try to set up document memory or local RAG pipelines. I built Hillock (https://github.c