CompanyAnthropic8 recent entries26 Sept 2026Introducing KoboldCpp Agent (and a plea for help)Hello r/localllama once again, it's me your kobold concedo Been a few months since I last posted here, and today I have something new I'd like to share. Specifically, KoboldCpp now ships with a built-→27 Sept 2026Public MCP server for Canadian privacy law data (free, no auth) - works with any client that speaks Streamable HTTPI built this, so the disclosure goes up front. It's a free, public MCP server plus a REST API with Canadian privacy law data. The MCP endpoint is at https://movahedi.ca/mcp and it uses Streamable HTTP
CompanyOpenAI8 recent entries18 Sept 2026My long ChatGPT threads quietly forget the beginning, so I keep decisions somewhere elseBeen working on this backend migration for like two weeks and my chat with ChatGPT is one of those endless scrolls. Last Tuesday it confidently told me we'd 'decided' on the wrong database. We had lit→18 Sept 2026MiniMax Code is now open source. Maybe M3.1 is the next thing to watch.MiniMax has released the source code for MiniMax Code’s terminal agent: https://github.com/MiniMax-AI/minimax-code https://preview.redd.it/st9izmm8zaqh1.png?width=3016&format=png&auto=webp&s=5853bc316→18 Sept 2026MiniMax Code goes open sourceMiniMax has open-sourced the terminal version of MiniMax Code: https://github.com/MiniMax-AI/minimax-code How can developers verify the content that encoding proxies read, send, and store? This is a t→20 Sept 2026Which model for reverse engineering?First time trying something like this. I asked chatgpt and it told me there are mcp server plugins for both ghidra and ida pro as well as RE-MCP which has support for both. I could run that on my low →20 Sept 2026An Open Letter to OpenAI: Please Don’t Eliminate Custom GPTs Until You Have a REAL ReplacementOpenAI’s decision to retire custom GPTs appears to rest on the assumption that Plugins, Skills, Projects, Apps, and Workspace Agents collectively replace their functionality. For many Small and Medium→26 Sept 2026Introducing KoboldCpp Agent (and a plea for help)Hello r/localllama once again, it's me your kobold concedo Been a few months since I last posted here, and today I have something new I'd like to share. Specifically, KoboldCpp now ships with a built-→29 Sept 2026What are your experiences with using a hybrid cloud/local setup to stretch usage for coding projects?For example, directly using claude code or code, which is then hooked up to automatically delegate the actual code writing tasks to a local model like qwen 3.8 flash next, to save on cloud usage limit→7 Oct 2026Running an open-source agent platform with no third party in the chain: what each piece needs (Ollama/vLLM, local embeddings, local OCR)Disclosure first: I work at Vstorm and I build AgenticOS, an open-source (Apache-2.0), self-hosted platform for building AI agents in a browser. This post was drafted with an LLM's help and edited by
CompanyGoogle5 recent entries10 Apr 2026OpenClaude com Ollama CloudOpenClaude is an open-source coding-agent CLI, forked from the Claude Code source, that adds an OpenAI-compatible provider shim enabling use of GPT-4o, DeepSeek, Gemini, Ollama local models, and 20...→7 Sept 2026Lit Review on Benchmarking LLMs Running in your phone!: MobileWorld: Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented EnvironmentsBack to reading about LLMs as agents on your phone doing GUI tasks! This time I read about MobileWorld: Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented Environments a→15 Sept 2026For Web game development, I swear Flash Next on Q2 is better than Gemini Flash 3.8One thing I love about both Qwen 3.8 27B and Flash Next is the effort it puts in to make a good product. It is the opposite of a lazy model and 'good enough' is never what aims to accomplish. It goes →16 Sept 2026Write up on building and improving reliability of agentic harnesses + a big dataset from my work.I've been working on something for this community (and other self-hosted communities) for almost 5 months now. Personally, I would grade it as probably the closest open source equivalent of Manus and →7 Oct 2026A stock GLM-Edge-1.5B-Chat on a 4GB Galaxy A04e completed a real Amazon cart taskYesterday TechCrunch published a piece about a growing problem for AI agents: websites are starting to block them. Amazon blocking Meta's Muse is the obvious example. At almost exactly the same time,
CompanyMeta8 recent entries30 Aug 2026Here my pretty good qwen3.8 27B setup, hope it helpsSince I spent the time to figure it out and it is not like it will make me any money ever. I think I'd share with you all what I managed to cobble together. First and foremost here the relevant bits a→6 Sept 2026vibeblending locally with Qwen 3.8 27BYou need Blender 5.x with MCP extension. I use pi so I also need: pi install npm:pi-mcp-adapter and then: $ cat .mcp.json { 'mcpServers': { 'blender': { 'command': '/home/jacek/.local/bin/uvx', 'args'→7 Sept 20269 easy steps for llama.cpp, a local model, Freecad (and pi coding agent) to generate solid objects that sound mechanically good and can be also be 3D printed/milledQuick setup on linux: STEP 0: install/download llama.cpp, Freecad, your favourite gguf model - possibly with multimedia image reading capabilities (I've used Qwen3.8-27B-UD-Q4_K_M and relative mmproj-→15 Sept 2026I trained a 44M parameter quantized LLM from scratch on 45B tokens. It ships in 19.8 MB and runs at ~1,900 tok/s on CPU. [P]Three weeks back , i posted SHADOW-250M here. It got 360 upvotes, 293 on r/LocalLLaMA and 94 GitHub stars. Thank you. That model was 60 MB, ran around 400 tok/s on CPU and could retrieve records from →16 Sept 2026Connected a local model (Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-Q4_K_M) to GIMP via MCP tools using llama.cpp - and here's the image result from my first prompt 'can you draw a picture of a flower in gimp?'. Needs work. Setup follows.can you draw a picture of a flower in gimp? So I ran through this setup to install the MCP server suite from GITHUB, it's pretty easy to follow the install - and installs the libraries necessary to co→7 Oct 2026A stock GLM-Edge-1.5B-Chat on a 4GB Galaxy A04e completed a real Amazon cart taskYesterday TechCrunch published a piece about a growing problem for AI agents: websites are starting to block them. Amazon blocking Meta's Muse is the obvious example. At almost exactly the same time, →10 Oct 2026Qwen 3.6 35B A3B: 131K context + vision on 6GB VRAMRunning HauhauCS/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive Q4_K_M with llama.cpp at ~600 tok/s prefill and 23 tok/s decode, 131k context window, Q8 KV cache - on an RTX 2060 6GB + 32GB DDR4 RAM. →12 Oct 2026VectorDash: A full Windows search replacement incorporating Embeddinggemma-2Inspired by DigUp for macOS, VectorDash aims to be a full Windows 11 search replacement, powered by EmbeddingGemma 2. Full indexing: search by meaning or exact words across photos, screenshots, audio,
CompanyMistral1 recent entries13 Apr 2026Ollama / Mistral with MCP to MempalaceThis Reddit post from r/ollama discusses integrating Ollama-served Mistral with MemPalace — a free, locally-run AI memory system — via the Model Context Protocol (MCP). MemPalace runs entirely on a us
CompanyxAI1 recent entries4 Aug 2026I added a verify-before-load safety check for Ollama modelsI maintain llm-checker, and I’ve added structural model-file validation for Ollama. Ollama stores downloaded models as local blobs. If one is truncated, malformed, or has invalid internal offsets, you
CompanyDeepSeek8 recent entries15 Aug 2026Agentic harness for small modelsHello; I'm a semi-beginner at local AI. I've been experimenting with this tech for a while, and I still haven't found a proper harness that fits my models, hardware, and needs. My use case is pretty s→19 Aug 2026Am I doing something wrong? Qwen 3.8 27B seems useless for agentic codingI have been using local models on/off for like 2 years or so but never really used them extensively because the closed ones were always much better. Once Qwen 3.8 27B was released I decided to give it→27 Aug 2026Running local LLM's as agents in Claude CodeI hit my token limit three times a day on my max subscription - got sick of that and designed this MCP setup to shift some of the coding load to my local Qwen3.8-27B model. I've been iterating on it n→28 Aug 2026I used Hermes Agent + ComfyUI MCP + MiniMax prompts to turn a music track into a short music videoThe initial reason for this was the Comfy H3 Sync & Sound Community Challenge: Comfy H3 Sync Sound Community Challenge! - by Allyson Toy I made a short rap track in Suno, then used Hermes Agent to bui→15 Sept 2026For Web game development, I swear Flash Next on Q2 is better than Gemini Flash 3.8One thing I love about both Qwen 3.8 27B and Flash Next is the effort it puts in to make a good product. It is the opposite of a lazy model and 'good enough' is never what aims to accomplish. It goes →5 Oct 2026I ran 1,200+ Blender modeling runs across LLMs and agent harnesses and made them votableBlind A/B arena where AI agents build things in Blender and you vote on which result is better: https://render-arena.izolight.xyz Each agent gets a prompt that describes its environment and the rules,→8 Oct 2026Open sourcing Game Summoner, my prompt to game sitetldr: Open sourced my prompt to game suite: https://github.com/ndamiano/ai-agent-test, it's MIT licensed, and this runs well on my 5090 with 64gb ram, but any model that can handle tool calls can mana→10 Oct 2026Qwen 3.6 35B A3B: 131K context + vision on 6GB VRAMRunning HauhauCS/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive Q4_K_M with llama.cpp at ~600 tok/s prefill and 23 tok/s decode, 131k context window, Q8 KV cache - on an RTX 2060 6GB + 32GB DDR4 RAM.
CompanyNVIDIA8 recent entries9 Aug 2026I Turned My Underused Gaming Laptop Into a Local AI WorkstationTL;DR: I am building a Windows-first local AI setup for people who want to try local LLMs without spending days choosing models, setting up Ollama, Docker, WSL, Open WebUI, agents, and tool permission→10 Aug 2026Introducing Muse Glimmer: an open-weight model optimized for always-on local agent workflowsHi r/LocalLLaMA 👋 Today we’re excited to release Muse Glimmer, a 30B open-weight model built specifically for local agent workflows. We’re releasing the weights to the community under a permissive Apa→11 Aug 2026Introducing Unsloth Desktop appHi LocalLlama, we're super excited to release Unsloth Desktop today! 🦥 It's the first desktop app that enables you to run and train models locally. Open-source. Available on Mac, Windows, and Linux Su→26 Aug 2026OpenCode with Qwen3.8-27B for Small Games or Browsing the Web With 16GB VRAMIn the past, I have use llama.cpp, but I read that the exl3 quantization format should give better precision, so I have tried exllamav3/tabbyAPI. It was able to write the shown simple HTML game withou→6 Sept 2026vibeblending locally with Qwen 3.8 27BYou need Blender 5.x with MCP extension. I use pi so I also need: pi install npm:pi-mcp-adapter and then: $ cat .mcp.json { 'mcpServers': { 'blender': { 'command': '/home/jacek/.local/bin/uvx', 'args'→30 Sept 2026Five local models, 6.8 GB of weights: my open-source Mac meeting notetakerhttps://preview.redd.it/xs01ds930nsh1.png?width=4800&format=png&auto=webp&s=939762bcf3fbd93e137d4f97e927dda38aaf30fd Back in July I shared LokalBot here. It's a free, open-source Mac app that records →6 Oct 2026Qwen Image 2.1 Uncensored MCPhttps://github.com/hypersniper05/MCP-Image-Generator-Uncensored Just wanted to share with you guys my workflow converted into an MCP. It's a Qwen Image 2.1 Uncensored MCP with a few extra models I fou→7 Oct 2026Ruach Studio: a whole song studio around YuE2 on your own GPU. Score first, LoRA training, stems,remaster, DAW export.We spent the last weeks building a studio around YuE2, the open song model by m-a-p, and today it reaches its first release candidate. Write the style and the lyrics, and it composes, sings and render