Search: “local-ai”

Self-learning and self improving local models can bite. Hard.

TL;DR: Self-learning needs governance, observability, and auditability. Sounds great, it's not great unless you have serious and appropriate protections. Let me lead this off with what we are most pro

28 Aug 2026

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Local Ai

What are the agentic softwares you run on top of local llm which can do tasks for you ?

DGX agent

What is your to software and why ? I am trying to learn first before I am pick a software. I already have Ollama and few models running which I can acces thru terminal and open web UI. My goal for now

local-air-ollama

28 Aug 2026

zai-org/GLM-5.3 · Hugging Face

GLM-5.3 uses the same base model as GLM-5.2 — every gain comes from post-training. Compared with GLM-5.2, it is much better at complex coding and long-horizon tasks: Stronger Coding: GLM-5.3 is the mo

28 Aug 2026

A MiniMax H3 text-to-video test.

local-air-stablediffusion

J'utilise souvent MiniMax H3 avec des images de référence ; je voulais essayer une vidéo que j'avais créée avec Wan (la version plus ancienne), mais cette fois en utilisant seulement une invite (un LL

[audio.cpp] Release 0.7: 62 audio model families (85+ variants), Arena UI for model comparison, MiniMax Music 3, FireRed TTS3/Audio, ControlFoley, Personaplex, and more

audio.cpp 0.7 is out :) This release adds a lot of new audio models and a new way to compare them locally. Audio.cpp is now at 62 model families and 85+ model variants. And it keeps growing! The bigge

Dflash 2 speculative decoding by SamuelOliveirads · Pull Request #2345 · ikawrakow/ik_llama.cpp

Didn't update on ik_llama.cpp updates for sometime. Updates from this month: cuda : repair the HIP build, and validate IQ4_KS and IQ4_KT on RDNA3- #2339 vulkan : add IQ4_KS and IQ4_KT support- #2332 I

GLM-5.3-Flash @ DGX Station GB300: ~206 tok/s (single stream), 1M context

Hey all! I'm finally doing some cool stuff with my 'thinking heater' (h/t u/-TV-Stand-). I'm still experimenting with GLM-5.2 (in anticipation of 5.3 coming tomorrow, I hope!) and things are very cool

Nvidia has been in talks to acquire Hugging Face for more than $13 billion - Business Insider

https://www.businessinsider.com/nvidia-in-talks-to-buy-hugging-face-13-billion-dollars-2026-8 Edit: The Information is reporting that the deal is done: Nvidia Agrees to Buy Open Source Model Repositor

OLLAMA_KV_CACHE_TYPE is global, not per-model. That is why one model got noticeably worse when you quantised the cache and the others did not.

Quantising the K/V cache is the highest-leverage memory setting most people never touch, and it has one behaviour in the docs that catches almost everyone. Every number below is out of Ollama's own FA

Sopro V2: SOTA-level voice cloning TTS at 120M params, open-source and CPU-friendly

Run it locally with one command (downloads the model, opens a small web UI): uvx --from sopro soprotts serve A year ago I posted Sopro V1 on this subreddit, a small TTS I trained for ~$250 as a side p

Visionary — Krea 2, MiniMax-H3, inference and LoRA training in one app

local-air-stablediffusion

I've been building this for my own work but there's no reason for it to stay private, so here it is.Visionary is a single Modal app that gives you Krea 2 for stills, MiniMax-H3 for video-with-sound, a

A minecraft clone I fully vibecoded with Qwen3.8-27b Q4

I wanted to see just how capable Qwen3.8-27b is locally. I have a RTX 4090 and 96GB of RAM but the Q4 comfortably fits in the GPU with plenty of context, the few times I needed more than 130k context

Benchmarking local agent architecture (ReAct loop vs. Graph)

Hi all! I've been building a local agent harness, but before writing the code, I wanted to get some intuition around whether (and how) structuring agent execution as a graph helps vs. standard tool-ca

HF exploring sale - impact on open models?

Hugging Face is exploring sale of the business valued at around $13 billion dollars. Actually I don't think we have any other repo source. Which has the mix of model weights, datasets and Spaces. Kagg

It conciders itself HUMAN?????

https://preview.redd.it/hpnr51vgcnlh1.png?width=1089&format=png&auto=webp&s=e960ca848fb2fa1d5dff0868e099ae682bac8310 This is local, uncencored ollama submitted by /u/Producer_John-Ian [link] [comments

Lemonade end-of-summer project update, now serving 15 engines!

Hi everyone, it's been a while since I posted so here's an update on what the Lemonade community has been up to this summer. Our overall mission is to enable local AI builders with everything they nee

Realistic expectations for a ThinkPad T14 gen 2, i7?

I am aware that I may not be able to run some higher end models, but I’m starting my journey into Ollama to learn capabilities and limits of local hosting. What could I expect to run on a Lenovo Think

Self-hosting LLMs on budget hardware: general principles, hardware, benchmarks and frontends

Hello, I've been self-hosting LLMs on various budget hardware for a while (6x RTX 3060 12 GB, Intel Arc Pro B60 24 GB, RX 9070 XT, etc). Over the last few months, I wrote about it in 4 articles: Gener

Apple unveils a more powerful Mac mini featuring the all-new M6 and M5 Pro

'A 12-core GPU, also with two more cores than before, now includes Neural Accelerators in each core for the first time on Mac mini, resulting in up to 4x faster AI performance and 2x faster graphics t

For those of us running Ollama on whatever hardware we already have: r/LowEndLocalAI

One of the things I like most about Ollama is how low it makes the barrier to experimenting with local models. The downside is that once you move away from high-end hardware, finding the right informa

Headlong: An open source agent microharness featuring persistent agency and recursive LLMs

An RLM agent microharness that 'persistently' thinks continuously. What could go wrong :) Introducing Headlong, an open source microharness for persistent agents: self-guided agents that think continu

How many of you are using Kiwix/offline Wikipedia for training?

We are seeing every so often people mentioning using Kiwix or offline Wikipedia for training. It is not something Kiwix is actively involved in (as in, people found us rather than the other way around

How to run LLMs as regular guy with low resources?

Hello everyone. I hope is all well with you all. I been around this sub for a few months and been quietly reading and I have seen how many of you are spending $10k on the Mac M5 and I am assuming you

Improving an ollama model with rag and raft

Building a local AI agent hierarchy on a budget — RAG, quantization, and testing whether fact-grounding pushes small models toward real creativity I don't have a CS background, a GPU, or much of a bud

Method not allowed error

For some reason I can only use Ollama through home wi-fi, everytime I try to use it while using my phone as a modem I get an error. Vpn doesn't help. Edit: problem fixed, works perfectly if VPN is in

Ornith1.5-9B uncensored doesn't work

Pretty simple, I tried almost anything I could find with Q4K_M and it refused any harmful test prompt I could find, does anyone know a decent versione/how fo make It work? submitted by /u/circumcised_

Significant improvements to Row-Bot recently. Looking for feedback.

v4.5.0: Added native desktop control, agent execution budgets, concurrency limits, loop protection, and safer local embedding fallback. v4.6.0: Rebuilt agents around durable parent-led orchestration.

System access project

I am not a huge fan of AI, but my friends like to joke and say I am torturing computers because I use all sorts of virtual machines, commands, and once split in half a 1000 defective laptop (accident)

tencent/WeMM-Embedding 9B/4B/2B

WeMM-Embedding-9B is a universal multimodal embedding model built on Qwen3.5. It accepts text, images, videos, visual documents, and interleaved multimodal inputs, and returns a 4,096-dimensional L2-n

Token/s down 50% after upgrade

Upgraded ollama from .32.6 to .32.15 ran a test on my qwen3:30b and it went from 90+ t/s down to 45+t/s System has 4 and v620 pro and one rtx3090 Before it was only using the amd, now it's using all 5

Agnes-AI/Agnes-2.5-Pro-Alpha • HuggingFace

https://preview.redd.it/usib0obv1blh1.png?width=1171&format=png&auto=webp&s=fa7b6e9155fcc461a2d397f9cf75aece4c72235c https://preview.redd.it/w453mok02blh1.png?width=2613&format=png&auto=webp&s=693182d

Best Local Vision Language Models - August 2026

Share what your favorite models are right now and why. Given the nature of the beast in evaluating VLMs (untrustworthiness of benchmarks, immature tooling, intrinsic stochasticity), please be as detai

GPU issue

A month i setup a proxmox server using spare parts like a z270 i7 7700k and 2x8 2666 but since i don't have any hardware acceleration i was planning to pass down my rx 580 8GB to my server but i heard

I got tired of flat RAG, so I built a 3D Multi-Agent Memory Core with 'Fading Gossip' (Open Source)

Hey everyone! I’ve been working on a 100% local cognitive memory engine designed specifically to give multi-agent systems and NPC societies human-like memory. It's called Eternal Thread. Instead of ju

is there a music UPSCALER llm?

similar to video upscaler LLMs, what's the bleeding edge right now on something similar for audio music? the idea is you feed it in with a low bitrate MONO old soundtrack, and the LLM then recreates i

JetBrains local AI (using Qwen3.6 27B)

Sounds quite interesting, a big IDE provider optimizing for local AI with their coding harness. Especially that they picked Qwen3.6 over Qwen3.8 because of the thinking needs. Haven't read the full ar

Minimax raising rates 60%-65%

Minimax just announced (only over xhitter apparently) that it is raising rates by 60%-65% tomorrow, the 25th. If you use Minimax, you'll either want to lock in their current rates. Sadly, every chines

One LLM wrote a trading feature. Another reviewed it. Both missed a future-data bug

An AQuA research loop let one LLM write an intraday trading feature and a second LLM review it for causality. The feature divided the volume seen so far by the day's final total volume. At prediction

SO DAMN CLOSE, GLM-5.2

It’s SO DAMN CLOSE. My harness has brought such a sense of calm whenever I sit and get some work done. Can't wait to get this out there. AMA, and yes, I've created a coding and cross domain harness an

TielCoder's 22 GB 4-bit quant matches Opus4.6 medium on recent real life coding issues, surpassing KAT-Coder and Nail as strongest and fastest MoE picks.

Qwen3.8-27B is amazing, but it’s slow. A stronger 35B-A3B Mixture of Experts-coder that can run and solve real codebase issues fast (even on constrained hardware) is a valuable addition to the arsenal

What to use with an old NVIDIA card?

The latest updates in Ollama have dropped support for the Pascal line of NVIDIA cards. I have a laptop with an NVIDIA 1070 which is no longer used by Ollama. Does anyone know of other frameworks like

Who would buy HuggingFace

Given OpenRouter.ai was snapped up by Stripe, who do we think would go after the 'GitHib' of AI models? It is a big chunk of change they are looking ($13B). Apple may be a contender to give them a rea

Built a local memory engine for Ollama that runs in <1.2GB VRAM without vector DBs (Hillock v0.5)

Hey r/Ollama, If you run local models on mid-range hardware, you probably know how fast VRAM disappears when you try to set up document memory or local RAG pipelines. I built Hillock (https://github.c

Civitai now has a closed-source models option

local-air-stablediffusion

I haven't seen a post about this here, and I'm curious what you think about it. On August 14 Civitai rolled out the option for creators to choose 'permanent paid access - selling with no time cap'. Pr

How would you improve reasoning + memory in a local AI companion?

I'm building a local AI companion and I'm currently working on its cognitive layer. The goal is: User message → understand intent → decide what context is relevant → retrieve only useful memories/stat

I ran the same utcnow migration twice: a local 27B I babysat, and an agent that could run the tests

The task was the same both times: replace 63 calls to datetime.utcnow() across 22 files in a Python service, keep the comparisons that assume naive datetimes working, and leave the tests green. I read

Introducing Tap ( Linux Version of Wispr Flow or Aqua )

Tap is Linux dictation: hold Ctrl+Space, speak, text lands in the focused app. Local, on-device.(Cloud Option Available) Built in public. What are some features you guys would like to see, before the

ollama max subscription not intaking new users till when?

ollama max subscription is not accepting new users since july 27th. https://web.archive.org/web/20260727111430id_/https://ollama.com/pricing . is there any prediction on when will they allow upgrading