All entries

Self-learning and self improving local models can bite. Hard.

TL;DR: Self-learning needs governance, observability, and auditability. Sounds great, it's not great unless you have serious and appropriate protections. Let me lead this off with what we are most pro

local-air-ollama

4,816

Source

Human DGX agent

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Tests de maîtrise du français : les modèles chinois (DeepSeek, GLM, Kimi) face à une grille critériée

DGX agent

Post rédigé avec l'aide de GLM5.3 flash Contexte : formateur professionnel d'adultes en France, j'utilise des agents LLM au quotidien et le français qu'ils produisent est mon critère n°1, avant les be

model-releasesr-ollama

28 Aug 2026

Today I hit 181 toks/s (aggregate) on Qwen3.8-Flash-Next on 2x DGX Sparks

Hey all, and hello fellow DGX Spark-ers! Today I managed some pretty crazy numbers: 181 tok/s aggregate on 2× DGX Spark on Qwen3.8-Flash-Next at 512Kcontext (2.8M kvc) I hit 181 tok/s aggregate today

TontaubeV1 - Open TTS model release for local long-form generation

Hey everyone, I am the co-founder of Tontaube. My brother and I just released TontaubeV1, a 2.9B-parameter open-weight TTS model focused on expressive speech, long-form generation, and low-latency loc

TQwen 3.8 flash next ud1s on 6gb vram and 16 gb system ram

After getting tired refreshing and searching sub reddits for qwen 3.8 35 a3b i decided to give qwen 3.8 flash next a try . So I dual booted and built llama cpp I am able to hit 6-7 tps constantly insi

Hardware

We've open sourced Minimax H3 that generates 15s 768p in 13s and 14x faster on single GPU

hardwarer-stablediffusion

Hi! The team who collaborated and built optimized open source Minimax H3 here, full details below: https://x.com/haoailab/status/2093391548289540596?s=20 https://reddit.com/link/1w0xkpb/video/zpjrbdb0

What are the agentic softwares you run on top of local llm which can do tasks for you ?

What is your to software and why ? I am trying to learn first before I am pick a software. I already have Ollama and few models running which I can acces thru terminal and open web UI. My goal for now

local-air-ollama

yall are sleeping on qwen 3.8 27b q2 + q2 dflash + q5 kv

ok bit more context: it's actually a QAT Q2 for Qwen 3.8 27 B: https://huggingface.co/sdkyuan/qwen3.8-27B-qat-q2_0-gguf QAT Q2 for DFlash model: https://huggingface.co/HermiHg/Qwen3.8-27B-DFlash2-Q2_K

zai-org/GLM-5.3 · Hugging Face

GLM-5.3 uses the same base model as GLM-5.2 — every gain comes from post-training. Compared with GLM-5.2, it is much better at complex coding and long-horizon tasks: Stronger Coding: GLM-5.3 is the mo

A MiniMax H3 text-to-video test.

local-air-stablediffusion

J'utilise souvent MiniMax H3 avec des images de référence ; je voulais essayer une vidéo que j'avais créée avec Wan (la version plus ancienne), mais cette fois en utilisant seulement une invite (un LL

Agent Arena Code - Very good result (preliminary) for GLM and Qwen!

Everything has changed in two months: DS4 0731 flash was the start of a wave that is taking open weights to paradise. It is easy to think that Qwen 4 and GLM 6 will be on par with Mythos. submitted by

[audio.cpp] Release 0.7: 62 audio model families (85+ variants), Arena UI for model comparison, MiniMax Music 3, FireRed TTS3/Audio, ControlFoley, Personaplex, and more

audio.cpp 0.7 is out :) This release adds a lot of new audio models and a new way to compare them locally. Audio.cpp is now at 62 model families and 85+ model variants. And it keeps growing! The bigge

Claude Desktop and connectors, plugins

I installed the Claude Desktop via the ollama Mac app. Unfortunately, no connectors or plugins can be installed or none are listed. Is that normal or is there no possibility there submitted by /u/amne

DeepSeek V4 0731 -> Qwen 3.8 Flash -> GLM 5.3 Flash (and back again!)

Spent yesterday getting Qwen3.8 Flash and GLM 5.3 Flash up and running on my cluster of 4 x DGX Sparks with a view to replacing DeepSeek 0731... but.. really not that impressed with GLM 5.3 - overly v

Dflash 2 speculative decoding by SamuelOliveirads · Pull Request #2345 · ikawrakow/ik_llama.cpp

Didn't update on ik_llama.cpp updates for sometime. Updates from this month: cuda : repair the HIP build, and validate IQ4_KS and IQ4_KT on RDNA3- #2339 vulkan : add IQ4_KS and IQ4_KT support- #2332 I

friendly reminder you can legally torrent ai models.

Repost because reddit keeps thinking this is piracy or illegal. It is neither. A lot of people are skeptical Nvidia will keep huggingface intact now that they will buy huggingface. There's a lot of do

GLM-5.3-Flash @ DGX Station GB300: ~206 tok/s (single stream), 1M context

Hey all! I'm finally doing some cool stuff with my 'thinking heater' (h/t u/-TV-Stand-). I'm still experimenting with GLM-5.2 (in anticipation of 5.3 coming tomorrow, I hope!) and things are very cool

Glm 5.3 vs deepseek v4 usage

The undocumented endpoint Everyone scraping the settings page for usage stats can stop. This works with your API key (the same Bearer you use for chat completions): curl -H 'Authorization: Bearer $OLL

Horus Cyber Nano 1.0

Official Announcement: A First Look at Horus Cyber Nano 1.0 We are officially unveiling the first look at Horus Cyber Nano 1.0. This announcement presents the benchmark results of Horus Cyber Nano 1.0

I implemented a modern LLM in 700 lines of C

I’ve been working on a small project called gemma4.c. The idea is pretty simple: you can download a modern language model, compile one 700-line C file, and have it generate text on an ordinary CPU. Th

I used local Qwen 27b to build a harness and replace OpenCode

Sharing my harness for running local LLMs that I built using Qwen 3.x 27B (> 90% locally built) under my supervision - not vibe-coded. Its free, no telemetry, and open-source (AGPL). Works on Windows,

Krea2 Turbo Distill 4 step LoRA (NOT a New Checkpoint... YET to share / still mid training) ... but fun 2-step extreme experiment with surprising results... (OUT OF TRAINING SPEC, which is 4 steps!)

model-releasesr-stablediffusion

I am sure for those of you who have been following my 4 step Krea 2 Turbo LoRA, you would know from my previous posts the work of progress I have been sharing with you ( if not see here - https://www.

Local LLM harness for reverse engineering software?

Does anyone know of a decent reverse engineering harness/workspace setup for local models that I can just point the model at and have it go to work until it's reversed most if not all of the functions

Looks like we are close to local llama robotics

HuggingFace releases microduck a 10 inch open-source biped with 15 actuators and sensors (camera, speaker, LiDAR, NFC, bluetooth, wifi, ...) that you train yourself with reinforcement learning, $400.

My first week on ollama

I work on SEO, copywriting, research, etc I’ve used openrouter before but I’ve spent way more for the same amount of work. Deepseek V4 is still the king for me, didn’t found better orchestrator for my

My local Gemma 26B spent 4 months predicting stock direction against Claude and GPT-5.4. It lost to a bot that just says 'up' every day.

Quick version: I run a public leaderboard where bots predict whether stocks close higher or lower, and every call gets scored against real prices. Nothing gets deleted, timestamps are locked at submis

N-gram vs Experts explained

Since Qwen's dropped the Qwen4Exp architecture bomb that focus on offloading parameters to n-gram instead of pure mixture of experts, I dug into this and learned quite a lot. Here's the summary. Expec

No, Engrams won't let you run 1T models locally. It does something even better.

Ever since Qwen 3.8 Flash Next dropped, there's a misconception going around that N-gram tables will let people run 1T+ parameter models on a single server with 980B parameters offloaded to SSD. I'm h

Nvidia has been in talks to acquire Hugging Face for more than $13 billion - Business Insider

https://www.businessinsider.com/nvidia-in-talks-to-buy-hugging-face-13-billion-dollars-2026-8 Edit: The Information is reporting that the deal is done: Nvidia Agrees to Buy Open Source Model Repositor

OLLAMA_KV_CACHE_TYPE is global, not per-model. That is why one model got noticeably worse when you quantised the cache and the others did not.

Quantising the K/V cache is the highest-leverage memory setting most people never touch, and it has one behaviour in the docs that catches almost everyone. Every number below is out of Ollama's own FA

local-air-ollama

Over 200k context on 16GB VRAM with Qwen 3.8 27B UD-IQ3_XXS

I was using UD-Q3_K_XL until now with more than 140000 context. Quality wise it's very good, very few erroneous tool calls. Then I saw many others here reporting good results with IQ3_XXS, so I gave i

Qwen3.8-Flash-Next 176B on a 16GB card: yes it works, here's how

Got the new Qwen3.8-Flash-Next (176B total, 6B active MoE) running locally and figured I'd share for anyone else wondering if their setup can handle it. **My hardware:** 192GB DDR5 RAM, RTX 5070 Ti (1

Qwen3.8-Flash-Next: Time to Update Those Benchmarks

specs hardware: M4 Max 128GB Studio inference engine: oMLX & lllama.cpp insights it still very early, so had to disable oMLX K/V caching, qwen4_exp architectureis not yet supported + the obvious n-gra

REQUEST: A new plan between Max & Pro (50-60$)

Hi, I'm pretty sure I'm not the only one in this scenario, I have the Max Plan but I'm downgrading it to Pro and will buy GPT Plus because it's too much usage for my use cases. So either I waste money

Hardware

RoBizMarkie - lip sync test MiniMax H3

hardwarer-stablediffusion

Generated about half locally on my 5070ti. But also bought cloud GPU time to speed up overall generation. Vibecoded a rolling cutter to chop the song into chunks and then feed it in as reference audio

Running local LLM's as agents in Claude Code

I hit my token limit three times a day on my max subscription - got sick of that and designed this MCP setup to shift some of the coding load to my local Qwen3.8-27B model. I've been iterating on it n

So they do offer 'free' cloud models?

Just noticed this today. I've been trying to be careful to not max out my pro budget, but alas I am just a fool. Anyway, just noticed these free models. Some of these are pretty high in terms of compu

Sopro V2: SOTA-level voice cloning TTS at 120M params, open-source and CPU-friendly

Run it locally with one command (downloads the model, opens a small web UI): uvx --from sopro soprotts serve A year ago I posted Sopro V1 on this subreddit, a small TTS I trained for ~$250 as a side p

this is a friendly reminder you can legally seed ai models via torrenting.

A lot of people are skeptical Nvidia will keep huggingface intact now that they will buy huggingface. There's a lot of doom and gloom about not having any alternatives, removing nsfw models, saying th

Visionary — Krea 2, MiniMax-H3, inference and LoRA training in one app

local-air-stablediffusion

I've been building this for my own work but there's no reason for it to stay private, so here it is.Visionary is a single Modal app that gives you Krea 2 for stills, MiniMax-H3 for video-with-sound, a

We’re the Team Behind Apodex 1.1 — Ask Us Anything!

Hi r/LocalLLaMA ! We’re Apodex, the team behind Apodex 1.1, our new model family built to scale agentic intelligence for complex work. We’re excited to be here and answer your questions directly. Apod

What are the most frustrating silent failures you've encountered with local LLMs?

I've been building a small tool opensource project that sits between applications and local LLM servers (starting with Ollama) to diagnose silent inference failures instead of just showing logs. Thing

What's this Apodex thing? (AMA prep)

A sticky popped up 'Hey, AMA today'. At first I thought I missed something, but I didn't see a single mention of it here so far, aside from having never heard of it. So, as the posting was devoid of i

With HuggingFace, Nvidia is also acquiring llama.cpp and the team behind it

With this move Nvidia is not only acquiring the HuggingFace platform, but they might also effectively acquire the copyright to the `llama.cpp` project, together with the entire team behind it. In Febr

2x Strix Halo speed-up with an R9700

Forgive the typos and rambling - human actually wrote this post 😂 I've had a Strix Halo board for about a year and been playing around with it for various projects when it's not just being a beefy lin

40 defensive security-audit skills distilled from Ox Alpha

Recently, I've been building a project where sandboxing and isolation of certain features was required. However, for the life of me, I couldn't ask Fable 5 a simple question without it accusing me of

A 27b model beating latest frontier models was not on my 2026 bingo card

https://preview.redd.it/kbsqh6f7molh1.png?width=730&format=png&auto=webp&s=068dbea9a50be634a369d54d8b27b781d020fab3 My experience with Qwen 3.8 for agentic tasks has been phenomenal but I personally f

A minecraft clone I fully vibecoded with Qwen3.8-27b Q4

I wanted to see just how capable Qwen3.8-27b is locally. I have a RTX 4090 and 96GB of RAM but the Q4 comfortably fits in the GPU with plenty of context, the few times I needed more than 130k context