Search: “r-ollama”

Gemma 4 - can't read images, why?

I've tried a few Gemma 4 models, for example 'gemma4:26b-mlx'. It says 'I cannot process images.'. On their website it mentions images, audio etc. https://ollama.com/library/gemma4/tags I’m using Olla

How would you improve reasoning + memory in a local AI companion?

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

I'm building a local AI companion and I'm currently working on its cognitive layer. The goal is: User message → understand intent → decide what context is relevant → retrieve only useful memories/stat

local-air-ollama

23 Aug 2026

I ran the same utcnow migration twice: a local 27B I babysat, and an agent that could run the tests

The task was the same both times: replace 63 calls to datetime.utcnow() across 22 files in a Python service, keep the comparisons that assume naive datetimes working, and leave the tests green. I read

I spent months pushing my RX 6700 XT into local AI. I think I seriously underestimated this GPU.

My setup: RX 6700 XT 12GB i5-11400F 16GB RAM Ubuntu 26.04 ROCm/TheRock + llama.cpp I've spent the last few months experimenting with different backends, quantization, CPU/GPU split, KV cache, batch si

Introducing Tap ( Linux Version of Wispr Flow or Aqua )

Tap is Linux dictation: hold Ctrl+Space, speak, text lands in the focused app. Local, on-device.(Cloud Option Available) Built in public. What are some features you guys would like to see, before the

Mozilla Killed Orbit. I Rebuilt It Locally and Privately.

Hey everyone! Last year, Mozilla released Orbit, an AI-powered browser summarizer hosted on a GCP server. After people started digging into the extension, they discovered things like backend endpoints

my experience with qwen3.8

i got it last week and im really impressed. its maybe like a sonnet from last year or 6 months ago. i had built some automation for myself and a dashboard cobbled together over the years from bits of

Ollama full GPU offload: `LLAMA_ARG_THREADS=1` drastically reduced CPU usage with no performance penalty

I noticed that a recent Ollama/llama.cpp setup was using a surprising amount of CPU despite the model being fully GPU-offloaded. My setup: Ryzen 9 9950X VM with 16 vCPUs 3× RTX 4060 Ti 16GB Qwen 3.8 2

ollama max subscription not intaking new users till when?

ollama max subscription is not accepting new users since july 27th. https://web.archive.org/web/20260727111430id_/https://ollama.com/pricing . is there any prediction on when will they allow upgrading

Trying to optimize LLM inference latency — Ollama + OpenWebUI/AnythingLLM

Hi everyone, I'm currently working on optimizing an LLM setup at my company and I'm trying to identify where the actual performance bottleneck is. Our current setup is roughly: LLM: NVIDIA Nemotron mo

Why has DSv4 0813 become trash?

It performs at full capacity without any issues anywhere, but only the Ollama DeepSeek seems particularly trashy. Why on earth has the Ollama DeepSeek unusable trash that goes into over reasoning and

Your model fits in VRAM. Your context doesn't. The KV cache math nobody shows you.

Spent way too long confused about why an 8B at Q4_K_M, about 4.9GB on disk, would OOM on a 12GB card. The weights fit twice over. The answer is the KV cache, and the math is simple enough that you can

Benchmarking qwen3.8:27b by having it port a 34k line C game to one HTML file. The agent mattered more than I expected.

My hobby project skill-issue is an arena FPS in a single C file, about 34k lines, everything procedural. My test for local setups is to have an agent port it to a single file HTML version with three.j

Cloud usage: 4-hr windows to weekly caps? (Pro $20)

Is there a good rule-of-thumb to calculate how many full 5-hour windows add up to one week's allowed usage under the $20/Pro plan? ie: you fill up six 5-hour windows, and that equals 100% usage for a

Gemax Ai New Version v1.9.15 (Offline AI Agent for Windows)

Gemax 1.9.15 — What’s new LAN server — share Gemax on your local network; open the real IP from another PC or phone Mobile-friendly UI — responsive layout for phone browsers on the same Wi‑Fi Workspac

How to make sure Ollama is using my Intel Arc A580, and not the CPU?

I have a Intel Arc A580 GPU that has 8gb VRAM, but I'm not sure that I am running ollama's local ai on it. Also, any suggestions on a good model to use for general purpose AI? submitted by /u/Illustri

Lightweight agent to use on laptop?

Hi there. I have a Lenovo Yoga laptop (16GB LPDDR5, AMD Ryzen 7 8840HS, integrated GPU). I have downloaded Ollama and installed Qwen 2.5coder:3b llm. I have tried OpenClaw, and Qwen Code but it seems

Ollama + llama.cpp + VS Code + OWUI + ...cloud?

I've been trying to figure out what the best configuration for my local stack would be and have been primarily determining this through trial and error. I wanted to get some outside opinions and stack

Row-Bot v4.8.0 is live

Row-Bot v4.8.0 is now available. This release adds provider-aware reasoning controls, letting each chat keep a valid reasoning choice for the exact model in use. Depending on model support, you can se

DeepSeek v4 Pro costs most... but it costs less...

When using DeepSeek Pro on Ollama, you'll see that the underlying cost is more significant. But if you actually track the usage, you'll actually find that, at least in my benchmarks, I save a lot of t

21 Aug 2026

K3 Usage Comparisons?

I'm confused by something I've noted in the recent discourse since Kimi K3 has been released on subscription. Has anyone done the (I know Ollama should display this) math as well on how much K3 is usi

21 Aug 2026

We built a local AI work tool that runs Qwen3.5-35B-A3B on a 16GB Mac

Hi everyone! I’m an intern at Icosa, a startup focused on making local AI accessible. We just released the first version of Zeno, our local AI product, and I thought it might be of interest to this co

21 Aug 2026

AMD setup is fast with 200k ctx with Qwen 3.8, i didn't understand how/why?

Hi all, it is my very first post, because I am so confused. First my setup: I have 2 X 7900XTX with rocm7.2.1 and I use it to fine tune small models and local llm etc. I run Qwen 3.8 27b 8 bit version

Connect Open-Webui to local Ollama does not show Ollama Cloud Models

Using Open-Webui I can connect to Ollama Cloud using ollama.com and the api key. It lists the models, it works. but i want to connect open-webui to the loacl ollama installation (windows) because all

[GUIDE] Running CUDA 12.9 on NVIDIA Pascal (GTX 10xx) with Arch Linux

Tested on: X570DD_M570DD / GTX 1050 mobile / Arch Linux x86_64 / NVIDIA 580.178.04 driver / CUDA V12.9.86 What happened: As everyone knows, NVIDIA dropped the Pascal line in the 590.xxx.xx+ and CUDA 1

home lab assistant llm

hey so im currently working to integrate a locally ran llm to control home assistant (through tool calling, no direct connection) so i can use a voice input without needing very specific commands. Its

I built a visual multi-agent workflow editor that exports runnable CrewAI code — here’s a 5-agent workflow running locally with Ollama

I've been building AgentGraph Studio, a visual editor for designing multi-agent workflows and exporting them as runnable Python code. One thing I wanted to verify was whether the generated code actual

Need help choosing the right AI model/tool for a complete web app workflow

I currently have these models available through Ollama/cloud: And I’m using Claude, Codex, OpenCode, and Ollama as my coding/agent tools. I want to learn professional vibecoding — not just asking AI t

So. about the speed of Qwen 3.8 27B Q2_K_XL on 3080 12GB

this screenshot is without MTP usage , fully offloaded onto the GPU. using LM STUDIO i wanted to ask you guys if theres a way to make it even faster , as MTP really didnt help and is infact slower due

VSCode Failed to fetch

https://preview.redd.it/xel6i6kujjkh1.png?width=2396&format=png&auto=webp&s=b78cd87da266324364e6b8cb8457a7f0e029d163 https://preview.redd.it/ofy8ttyxjjkh1.png?width=2396&format=png&auto=webp&s=3e64405

What do you think of my Modelfile for Qwen3.8

Hello, any params I missing or mis-tuning for my coding model ? FROM ./models/unsloth/Qwen3.8-27B-Q5_K_M.gguf # Generation parameters optimized for logical reasoning and coding tasks PARAMETER tempera

After Price hike DeepSeek-V4-Flash:0731 is dumb in opencode & Else where. How it is in Ollama cloud?

seems like others are now using lower precision models. On open code sub i see a lot of people saying model has gone dumber since price hike started. How it is behaving in Ollama cloud PRO? Same? subm

Creating an account problems

Trying to make an account so I can start using Odyssey and to download some stuff through PowerShell. It requires a sign-in, but I can't make an account on the site because i need a U.S number and I d

Has anyone else noticed DeepSeek-V4-Flash:0731 using way more Ollama Cloud usage lately?

I’ve been using deepseek-v4-flash:0731 on Ollama Cloud, and recently it feels like my usage is getting consumed much faster than before. My prompts and general workflow haven’t changed much, but the a

I benchmarked Qwen3.8 27B on browser tasks. It's on par with GPT 5.6 Luna (xhigh)

The benchmark I used is BU bench v1, and the open source harness is Browser Agent. Qwen3.8 27B beat all other affordable or open models I tested. It's insanely good! submitted by /u/pierreb5 [link] [c

I built Polish – A local AI text polisher and Oracle SQL fixer for Windows with automated PII data masking

Hi everyone, I built an open-source Windows desktop utility called **Polish** that lets you highlight text or SQL in ANY app (Slack, Teams, Outlook, DBeaver, SQL Developer, browser) and rephrase or fi

I'm literally brand new, what's the best unrestricted model atm?

Hi folks, I have a 7800x3d + 32GB RAM + Rtx4090 and > 200TB of storage. I downloaded the Qwen 3.7 35B hauhaucs but it has been a disappointment so far because training data is too outdated (networking

Qwen 3.5 cybersecurity

Hi guys , this is a fine tune of qwen 3.5 4b on cybersecurity , specifically malware. This model has been trained on 2.6k rows of simple but effective malware code , though its still significantly lim

Was Meta's Muse Glimmer 30b a distillation of an OpenAI model?

Hi all, I'm new here. I was playing around with the newly release open-weight model released by Meta, and I came across this when asking who it was made by, it said 'OpenAI'. Publicly, Meta had stated

What’s the best Ollama Cloud alternative right now?

My current setup is basically OhMyPi+ OpenCode (mostly OpenCode Go: DeepSeek, Flash, V4, etc.) + Ollama Cloud for stuff like Kimi and GLM. But honestly, I feel like Ollama Cloud has gotten noticeably

Does an Ollama-ready build keep this 27B's MTP and vision stack?

One line in a new Qwen3.8-27B derivative card caught my eye: the uploader says the vision-language tower and MTP head were preserved through its offline block-FP8 build. The checkpoint is OrcaRouter's

How reliable is that models from the library are 'the real deal'?

Yesterday I downloaded Qwen3.8 as MLX from the Ollama library from the commandline on a MAC. Simple 'Ollama Pull xxx' This is the answer I get when I ask it what model it is... I swear to god this is

How to optimise local AI for lots of RAM but not a lot of VRAM?

Im running a Ryzen 7 5700x, a 3080ti (12GB) with 64GB of RAM. I’m still new to Local AI, and I’ve tried it in the past but none of the previous generations of AI have been good enough for my specific

I built a local AI workspace for Windows and finally released it

After about a year of building, testing and constantly finding things to improve, Nyx AI is finally out.available in 240 market in 6 languages Nyx AI is a local first AI workspace for Windows for chat

I'm going to optimize our AI co-work experience

Hey everyone, I am trying to make a LLM interface optimized for AI-cowork experience. Heres what I've thought of and tried to fix: 1)You shouldn't have to copy and paste context for the AI model. 2)Yo

Local LLMs for use with Obsidian vault

I have a lot of content in my personal Obsidian vault and would feel much more comfortable using LLMs with an offline model. I've experimented with Ollama and various small 3b/8b local models (given c

Local Qwen 3.8 27B vs GPT‑5.6 Terra vs Grok 4.6

I gave three AI models the same brief: build a premium Three.js fragrance launch site from the same Git baseline, independently and with no collaboration. Three very different results. Here’s the full

NYX AI

The AI wants to run a higher risk action. Nyx AI stops it here. Nyx AI deliberately invokes a native Windows confirmation before certain higher risk actions can continue. The model cannot approve this