Current AI
One thing we realized about AI is that when you ask it a question and have a conversation, the AI may give you a real answer, but it doesn't connect you to the real community behind your question! sub
Knowledge catalogue
One thing we realized about AI is that when you ask it a question and have a conversation, the AI may give you a real answer, but it doesn't connect you to the real community behind your question! sub
I think these models are fairly comparable in performance but which uses more compute in the old subscription model? The old subscription model is at least still working in compute usage instead of co
I would like a toggle in settings that I can switch on to use my extra credits I paid in my balance before using my plans usage. I’m on the old plan with usage. submitted by /u/ParticularlyStrange [li
I developed https://lora-hunt.info/ for finding LoRA/PEFT adapters that might work with local LLM setups. The site collects public model metadata from Hugging Face and tries to make base-model compati
I released KaozKit this week, a Swift library for running LLM agents written in JavaScript inside a Mac app. Built from the start to keep everything local. Providers: MLX with Hugging Face model manag
I've been building Selfcoder, a VS Code coding agent focused specifically on local models. I originally started working on it because I was frustrated with the context management when using local mode
Hello, I'm at the old pro plan. With the upcoming cloud model retirement of deepseek v4 0731 flash in mind because 4.1 is supposed to be more efficient while providing even better results I remembered
I spent the first week of September building a personal assistant over Gemma 4 in Ollama on a 16 GB M1 Pro: Node backend, React web UI, Expo phone client, two-model routing, cross-session memory, RAG
Hi Ollama Team, I’m writing regarding the announced retirement of GLM-5.1 from Ollama Cloud on 25 September 2026. I wanted to provide some fairly detailed technical feedback because GLM-5.1 is not sim
omg why are they doing this ? im getting so much request from deepseek-v4-flash:0731 comparing to dsv4.1-flash :( anyone know some alternatives which still uses 0731 flash ? submitted by /u/subimpact
Anyone interested in trying out a new inference provider? We're testing Gemma 4:26b and Qwen 3.8:27B behind an OpenAI-compatible API and looking for a few users to give them a spin and tell us how it
I wanted to test what Qwen 3.8 27B running locally on a single 5090 could do in Row-Bot. I gave it just one prompt: 'I want you to create an animation showing what the current local model can do. Test
Hi All. Just tried to down the NVFP4 version from Ollama but it’s the MLX!? Anyone else been able to access this version? Only have 1 DGX so wanted the smaller footprint for user with Hermes. Any sugg
I'm documenting a reproducible setup for running current llama.cpp on a mixed AMD Vega system with both: Radeon RX Vega 64 / Vega10 / gfx900 (8GB HBM2) Radeon Instinct MI50 (Vega20) / gfx906 (16GB HBM
I’m developing this https://swarm.dafonet.com If someone want to collaborate? I’m looking for people with capabilities to test it in different infraestructures. Best regards Gabriel Giani submitted by
Hey everyone, Giving AI agents access to MCP tools or shell commands is awesome, but prompt injection is still a huge headache. If an agent reads an untrusted document containing `ignore previous inst
I’ve been building Catalyst around a capability I want engineering agents to have: An AI agent can read a program and make a good guess about what matters. Catalyst lets it measure what actually matte
I tried using deepseek v4.1 flash max subagents with astra extra high as an orchestrator. It was working perfectly with 1 until it suddenly stopped responding or doing work after 3 hours. Then trying
Can someone explain to me why Ollama Cloud are billing with same peak/off peak windows as Deepseek since they are hosting the model across US/EU infrastructure? submitted by /u/veganmaister [link] [co
I'm a teacher looking into running an LLM locally. I've been using ChatGPT for a lot of this work, so I started looking at Ollama because I understand it's designed to run LLMs locally. That said, I'm
I recently moved to Japan and ran into an issue where a lot of anime on Netflix only has Japanese subtitles here. I wanted something similar to the subtitle translation extensions that already exist,
We’ve been watching both models closely on InferX, and something interesting is starting to show up. GLM-5.3 Flash might actually be outperforming DeepSeek V4.1 Flash for some real-world workloads. To
Same 44-token prompt: low = 202 output tokens in 15s, max = 4,955 in 35s, unset = 10,579 in 68s. I'm using it via claude code with this: CLAUDE_CODE_MAX_CONTEXT_TOKENS=1048576 ollama launch claude --m
I tried GLM flash a few weeks ago and expected the token weekly limits to be comparable to DS flash. For some reason, it was a huge use of my limits. Am I the only one with this issue? I did send a su
I’m genuinely mind-blown by what’s happening with AI models right now. On one side, you have GPT-6-class frontier models that are just… insane. The level of capability is getting hard to wrap your hea
Tested on Laptop with RTX 5060 8gb vram and 16gb ram Claude code - autocompact = false Ollama - Flash attention = 1, kv cache = q8_0 Gemma4 12B 64K - https://ollama.com/SetneufPT/Gemma4-12B-IT-QAT_Q4_
Hey everyone, If you run local models via Ollama in production or personal projects, you've probably run into the hallucination problem: how do you know when a model is hallucinating without burning e
That's amazing. I've been using the pay-as-you-go plan, and because DeepSeek 4 Flash wasn't great, I was using GLM 5.3 Flash instead. But now that I'm using the high-performing DeepSeek 4.1 Flash, the
https://preview.redd.it/4c6otbeg1qoh1.png?width=1139&format=png&auto=webp&s=2d127bd3bc83d5e6ba65c3a4bd909529f34e9a3c Total beginner here, i've just downloaded Ollama and Gemma4:26b, but when it answer
First off, I'm super thankful for the value Ollama has given me Got me setup with my first local LLM setup (early OpenClaw days amirite!?) Then got me into their 20 plan and what really sold me here w
Spent about two weeks convinced I had a prompting problem. My local Qwen3 agent would just stop. No error, no crash, finish_reason came back as 'stop' like the model had decided it was done. Except it
are very strict... if 20 calls to kimi are more than my 5 hour limit why even bother? im gonna cancel my sub for sure https://preview.redd.it/gbqkci93gnoh1.png?width=1080&format=png&auto=webp&s=6fac5a
Anyone else play with vllm-mlx? There was an interesting paper that came out that compared this version of vllm that was originally designed for multi modal inference performance gains, but ended up s
In july I posted here about aletha codex and I got a lot of support, and a decent amount of people started using it. I also got a lot of criticism too, which really helped me funnel this version 1.5 t
im new to using ai so i may be missing something. I set up ollama but dont want any of my data to go to any of the model providers, for certain models i appear to need an api key to download the model
I shared ThoughtDAG here a while ago. I've now recorded how I use it: select a phrase in an answer, explore it on a branch, and connect the parts I want in the next question. I'm the developer. Though
I'm using two different models. One Gemma 4 and the other qwen 3.5. Both of them are responding to my input either by silence ('thought for a moment.... then nothing') or nonsense: <|turn>user <|turn>
I’ve been experimenting with explaining AI/LLM concepts in a way that doesn’t assume too much technical background. This video is about KV Cache and why longer context windows require more memory duri
I was curious about how AIs talk to each other and how a conversation changes as it goes on, so I built AI Arena Lite. It connects to Ollama and lets you assign models to different agent roles, follow
https://github.com/paulknysh/raggy A lightweight CLI tool for Retrieval-Augmented Generation (RAG) over local documents built with Ollama. Hybrid database (vector + BM25 index) and embedding generatio
I've been running Claude Code as my daily driver and wanted Ollama models in the loop without giving up the harness. So I built gremlord, a small Go binary that points the unmodified claude binary at
Hi, I have the biggest pro subscription.. had it for months.. been using more or less the same models (GLM 5.x) - i would averagely be at 95% on a sunday.. and it would renew at Monday. Now we are att
I only just found ollama, but I ran into a problem described in this conversation from years back: https://www.reddit.com/r/ollama/s/YZ88XkHmIS Has nothing changed? The storage seems a mess. I had to
Confirmed by my weekly Hermes analytics. Estimated at roughly 50% cut in weekly and session limits. Which cloud inference plans are you all migrating to? (I understand that local inference is preferre
I kept picking local models badly. Parameter count, quantization, VRAM. I could read all of it and still not know whether a model would be any good on my machine. So I stopped guessing and wrote somet
Hold right Ctrl, speak, release. faster-whisper (large-v3-turbo) transcribes on your own GPU, then qwen2.5:3b-instruct through Ollama cleans the text up: filler words out, punctuation in, spoken self-
Hey so a few months ago I got into local LLMs and didn’t really like the tools out there at the time, so I decided to build my own version of a Claude/Codex GUI for local models. I’ve been working on
I was thinking about using WebUI but I have a big problem with ollama serve command. Basically I made a python script that uses Ollama API and it works damn well if I don't serve the Ollama server man
Hi everyone, This is probably a simple problem, but I can't get my head around it. I am running ollama 0.33.3 on Linux Mint Cinnamon 21.3 with separate partitions for root and home. The standard insta
Ok I know I'm likely to get steamrolled here but I also have a sense of optimism and hope I can get some sort of answer that will be beneficial. We all know since the new price structure, usage has sh
Setup, so the question makes sense: my coding agent's memory now lives in a folder of Markdown — entities, episodes, and procedures (workflows with a per-step success/fail record). Nothing needs an ac
I just tried to run Qwen 3.8 27B 4bit qwant on 5060ti 16GB and got terrible results. With Qwen 3.6 I got something around 15-20 tok/s. Are there any combination of parameters or tweeks how to push the
I’ve been setting up an M1 Max Mac Studio (24-core GPU, 32GB unified memory) as a local LLM server and wanted to compare MLX vs llama.cpp on Qwen3.8-27B. I tried to keep the model footprint and benchm
Claude Code is absolutely horrendous at managing docx XML structures and it's obscene that the best these frontier companies can do are skills. Skills are prone to breaking, burn tokens (hello busines
I am working with multi-language content and have so far been useing gemma4:e2b for general work. Today I tried it with Russian for the first time and the result was not great. Gemma4:e4b was better,
I like Nvidia, Ollama, and Hugging Face. I wish each of them well. But one owning the other creates a huge conflict of interest. Separation of Powers is key for long term sustainability of open weight
I might be missing something obvious, but when I open any cloud model, by default I'm dealing with the 200k version and the first thing I need to do is /model to change it to the 1M version. Is there
Bruh wtf, i switched to new method now im pissed, 20 dollars a month for 60 api cost a month ?? Open code provides this for 10 dollars a month , and if I use a beast like kimi k3 I can drown my months
Everyone is talking about how the new credit system gives significantly less usage than the old Ollama Pro limits, but there's another part of the pricing that seems a bit crazy to me. For example, I
I have a few AI subscriptions and I kept running into the same problem. I had powerful models available, but I struggled to use them in real life in an organized way. I looked at projects like OpenCla