A Little Help Please?
https://preview.redd.it/9k5fw4j47puh1.png?width=545&format=png&auto=webp&s=ff0a6ff6fb69ae9a9bcd579bd612c553fc3e2a00 https://preview.redd.it/xcwzlmo77puh1.png?width=664&format=png&auto=webp&s=c8a637e2e
Knowledge catalogue
https://preview.redd.it/9k5fw4j47puh1.png?width=545&format=png&auto=webp&s=ff0a6ff6fb69ae9a9bcd579bd612c553fc3e2a00 https://preview.redd.it/xcwzlmo77puh1.png?width=664&format=png&auto=webp&s=c8a637e2e
I ran a small test for Dory to see whether a local model could update one fact in a synthetic notes file without losing any of the others. I asked Gemma and Qwen to rewrite the file, return a patch, o
Hey everyone! 👋 Feeding multi-gigabyte files (SQL dumps, videos, audio, PDFs, and spreadsheets) directly into LLMs often causes context window overflow, GPU VRAM bottlenecks, massive token bills, and
I am developing a Windows-based local AI virtual spouse application that supports adult roleplay. My goal is to run it without a server or external AI APIs. I am looking for existing open-source modul
Hey everyone! 👋 After months of building, we’re finally opening the first spots for **Many Agents**, a new product from Dome. The idea is simple: **What if you could create your own team of AI agents
I made BigMoeOnEdge+ (BigMoeOnEdge-plus), a fork of Helldez's BigMoeOnEdge, the engine that streams MoE experts from flash so models bigger than RAM can run on-device. It adds a full Android chat app
I checked the site, and it didn't say anything about mlx only on the ollama models listing. So why is this restriction in place? ollama pull embeddinggemma-2 pulling manifest Error: this model require
Hi everyone! So far in 2026 I have been iterating and evolving a research system I designed to help me sift through things that LLMs all agree on that may not be correct, and to give me actual confide
Disclosure: I'm the developer. The app is called Citenook. I wanted to ask questions across a few hundred PDFs and notes with Ollama, but every setup I tried either needed a lot of glue code or gave a
ik ik 'another harness D:'. so... i spent the last 6 months of my life building and ironing out every single detail and bug through almost every route with extensive testing across 3 machines, daily,
I've been building ANCHOR, a web automation agent that runs entirely on Ollama. You describe a task in plain language ('Register Maria Silva, IT department, contractor, and save'), point it at a site,
Disclosure first: I'm one of the maintainers, this is my project. If you've pointed Open WebUI or a script at a local server, you know the failure modes: the server restarts and every conversation is
In my attempt to combat powerty; as electricity cost a ton these days and it is hot as hell, I consolidated 2 machines into one, so my 2 crappy machines now are one, and that means a bit less power an
Wanted to share a local memory engine I built called Hillock. The main problem I had with standard local RAG was that running document parsing and vector search chewed up so much VRAM that my actual O
Every time I try, I'm met with this: error message: Error: max retries exceeded: Get 'https://dd20bb891979d25aebc8bec07b2b3bbc.r2.cloudflarestorage.com/ollama/docker/registry/v2/blobs/sha256/00/001e5d
I am sure people need it you know? There are plenty of embedding models on ollama, but only for local deployment. Which is a shame. I wish ollama would make embedding and rerankers available on ollama
Thursday, October 8 — 15:00–19:00 UTC Access is free and the API is OpenAI-compatible. During those 4 hours, everyone will be asked to use it actively at the same time—coding, chatting, agents, long c
I recently installed ollama on my machine to test using AI locally, I don't know if you will be able to hear it on the video but every time my terminal outputs a response there is this weird writing/s
Seems like a bit of a long shot, but since it’s so mystifying I figured I might as well ask: I have been trying to get Qwen 3.6 35B to function as a local implementation agent in my subagent driven de
Disclosure first: I work at Vstorm and I build AgenticOS, an open-source (Apache-2.0), self-hosted platform for building AI agents in a browser. This post was drafted with an LLM's help and edited by
Hey everyone, I'm looking for a small uncensored model to run locally with Ollama. Nothing fancy. I just want something I can ask everyday questions without it refusing or lecturing me every other mes
Never saw mimo2.6, now im doubting mistral 4 wont land either ... I feel trapped but im not sue its worth the $100 ... just few options anyone know any details behind the change? submitted by /u/stack
One prompt to Row-Bot 5.0 on GPT 6.1 Sol, through my ChatGPT plan (no API key): 'Split the research across three helper agents working in parallel, cite sources, save the findings, then build a 6-slid
Row-Bot 5.0 with qwen3.8:27b in Ollama, on my own GPU. No API keys, no cloud. Gave it a year of bills, a tenancy agreement, an insurance policy and a rent increase letter (all made up). It spotted a l
Maybe I'm mistaken, but wasn't one of the big pros of Ollama Cloud inference that it was all hosted by Ollama? If that's the case, why duplicate the Deepseek on-/off- hour premiums? Surely they do not
A small thing I noticed: full-size screenshots use far more AI tokens than the model needs, so usage limits run out sooner. I built a free Firefox add-on, TokenSaver, that shrinks images before they a
I wanted to build an offline bird/plant identifier that runs on a laptop with Ollama. Before building any UI, I tested it on 6 photos: Common Myna → gemma4:e2b said 'Jackdaw' (confidence: high). gemma
Ollama Cloud Model pricing monitor with tabled costs and calculator. https://kasp0r.github.io/ollama_cloud_models_comparison https://preview.redd.it/hxbpnuq7quth1.png?width=1372&format=png&auto=webp&s
Hi, I'm on M4 Pro 64GB Mac, I'm using Qwen3.8 27B for coding related stuff, but it's quite slow. I want a fast model that will be good when it comes to reasoning, medical stuff, would be nice if it co
I wanted to test how well local models perform in agentic development with Copilot CLI. I started ollama launch copilot --model qwen3.5:9b. I gave it simple instruction in autopilot mode to create a f
I've been using deepseek for long and made valuable outputs and resources, but since the update to the 4.1, deepseek just feels dumb. I ask a simple question and process for long, doesn't plan before
I want the smartest local model I can run that also does not refuse. Not a tiny 'uncensored' 8B. Not a censored model with a jailbreak prompt. Tried dolphin-llama3:8b with a custom SYSTEM prompt. It c
What modle works on a 16 GB laptop i5 intel I have an old machine lying around and tried running a few models and non seem to be good, the response time is 4 mins and above Models tested: Google Gemma
I've been experimenting with running larger models locally with Ollama, mainly because I'm interested in using them for agentic coding. I kept seeing benchmarks expressed as something like: 40 tokens/
I wanted my agent to do boring web chores: check an order, star a repo, fill in a form. Every time, it hit a login page and stopped dead. My options were to give it my password and cookies, or sit the
I am trying to import two large datasets to enable statistical analysis. After importing the second dataset, Ollama tells me it has no record of that dataset. Intel i9-11900KF Nvidia 3080Ti 12GB Ubunt
Row-Bot 5.0 is a major rebuild of the local-first AI assistant. The NiceGUI interface is gone, replaced by one React app across desktop, browsers, phones and tablets. The biggest change is how work is
'Tuesday, sorry Thursday' is not the same as 'Tuesday Thursday'. And losing 'don't' is a pretty big edit. What do you put in tests for the cleanup step? I'd start with corrections, names and numbers,
https://preview.redd.it/5w22g46ihssh1.png?width=2880&format=png&auto=webp&s=cbae24190847b3d80b919ce72d6703c9d1a5a52d The best agent experiences I tried (Dots/ GrokBot) all had an agent that can actual
Every time I needed to explore a dataset quickly, the same wall appeared — cleaning boilerplate, encoding errors, deciding which chart actually makes sense. The mechanical parts aren't interesting, th
Wanted to share a project I've been working on to give local Ollama models persistent document memory without needing heavy vector databases. It's called Hillock. The main problem I had with standard
Hi everyone — I'm behind Autonomous Workday, and I'm sharing an English-language architecture walkthrough about building an event-driven workflow around local inference. The proposed flow separates fi
I built a free tool that lets your coding agent make videos like this one. You give your agent the link to the repo and say what the video should be about. It writes the words, draws the scenes, and y
Anyone else experiencing this issue this week in particular? I am getting WAY less requests this week than usual, no matter what model I am on. I actually had to discontinue things I was doing because
RuntimeAI's September 2026 AI Security Report covered 126 incidents across 38 named organizations — 22 critical, 102 high severity. 53 of those incidents had AI either as the attack tool or the target
Building a local voice chat pipeline: Struggling with fast, natural PT-BR conversation models I'm currently trying to build a local AI voice chat system that can use tools via an LLM. I'm testing tw
Running things locally already means you care more about control and reproducibility than most. Worth extending that to your prompts too. There's a live workshop on Oct 3 covering exactly that. Serj S
I run local models through Ollama and kept hitting the same quiet problems, so I wrote a scanner for them. llm-doctor checks your model stores (Ollama, LM Studio, Hugging Face, MLX) for duplicate weig
Hola a todos! Tengo un MacBook Pro m3 con 16gb de RAM. No me siento cómodo con los modelos que he probado y me gustaría saber qué modelo os sentís cómodo y para que lo usáis Muchas gracias! submitted
I've been struggling with the ollama update process. I have both nvidia and amd GPUs in my system. I have two instances of ollama running on different ports for this to work around issues. AMD 7800xt
I'm tired of watching my compute budget and topping off my Ollama account. It feels like I can use a mix with more flash models on Openrouter (things not all available at Ollama) and control my spend
Ollama’s new limits and max plans are worrying me, so I’ve been going harder on my harness. (Thanks to everyone who’s signed up for the waitlist so far.) Wanted to share how my v1.10.0 will dramatical
Apple Foundation Model 3 through Private Cloud Compute is directly available in macOS 27.2 through familiar AI clients. For Mac users running local models such as Qwen 3.x or Gemma 4, AFM 3 PCC is a c
Processor Intel(R) Core(TM) Ultra 5 226V (2.10 GHz) Installed RAM 16.0 GB (15.7 GB usable) Graphics card Intel(R) Arc(TM) 130V GPU (8GB) (128 MB) Storage 273 GB of 954 GB used System type 64-bit opera
Hi, I’m using Qwen3.8 27B in my vulnerability scanner, it does scan JS files, tries to generate exploits etc. I’m using uncensored version, the model is like 21GB. Running it on Mac M4 Pro 64GB ram, i
I wanted a fun way to visualize and stress-test a multi-agent ecosystem, so I pointed it at my favorite MMO (a vanilla-era private server emulator). Live view: https://design.kristiantalley.com/projec
Hi, I'm a long time subscriber of their pro plan. In the past, they were adding the open weight models to their catalog as soon as they dropped. Since this new change in their payment plans, I haven't
https://preview.redd.it/2fvmzd4f3ish1.png?width=952&format=png&auto=webp&s=d21e33fd26b46d2268a12219d8c0619666eb000e I thought something was off because browser_search was taking almost a minute for a
This keeps happening and has been happening for over a month now. Since ollama has zero support I'm hoping someone else has figured out a work around for the issue. I'm using the latest version of ope
A while back I posted here about a CLI agent I'm building that parses tool calls out of a model's plain-text output instead of trusting native function-calling to work. Finally ran the actual numbers.