ToolClaude Code8 recent entries8 Aug 2026PSA for anyone with multiple V620's or other gfx1030 cards having problems making llama.cpp tensor split work -- set '-ub 384' and -b to a multiple of that depending on number of GPUsBasically what the title says. For me, it would always crash and burn trying to use tensor split. Apparently, there's some bug where GPU memory gets corrupted with the default microbatch (512) or high→8 Aug 2026DeepSeek V4 Flash 0731 appreciation postI’m running DSV4F 0731 on dual spark, and honestly… wow. It’s an absolute workhorse, and the benchmarks are real. Everyday tasks with Hermes agent? Effortless. Coding tasks with OpenCode? I’m genuinel
ToolCursor3 recent entries23 Jul 2026CPU-only inference on a Celeron N5095 SBC: 6 models from 0.6B to 8B, benchmarkedI wanted to know how cheap you can go and still run local models, so I ran Ollama CPU-only on a Youyeetoo X1S. It's a single-board x86 machine with a Celeron N5095 (Jasper Lake, 4C/4T, 15W), 16GB of R→25 Jul 2026Is it worth getting 128GB MacBook Pro? Will it ever be comparable to today’s frontier models for coding?I am a long time iOS app developer. In the last year I have been using Cursor+Claude/others to assist with app development. I am concerned that the current low pricing will disappear eventually. I am →5 Aug 202640% speedup of MoE training with faster megakernel, by cursor, of all people (for B200s)daily reminder not to trust benchmarks and run it yourself. claimed e2e speedup is ~40%, forwards are ~140% faster I would wager that compared to a naive kernel anyone can write it's more in the range
ToolOllama8 recent entries25 Jul 20265700, 48GB RAM and a 3090 24Gb. Best OS and framework/model?Hi everyone, I have a system which I have been using for gaming, R7 5700X, 48GB DDR4, RTX3090 24GB. But I want to use it for Local AI to reduce my reliance on cloud AI providers (mainly usage limits -→27 Jul 2026My Ollama box picks the music now: an agentic DJ running on a 9B modelI got tired of my Ollama server sitting idle between chat experiments, so I pointed it at my Navidrome library and made it run a radio station. The DJ is an agent, not a shuffler. Each turn it gets to→28 Jul 2026Agenta: an open-source Claude Cowork alternative where you can use self-hosted models (and any harness)Hey r/LocalLLaMA, I’m Mahmoud from Agenta. We built a self-hosted, more flexible, alternative to Claude Cowork . This short video shows how it works. I use it to build AI coworkers for my startup, lik→2 Aug 2026PSA: llama.app, Mac app and llama serve from llama.cpphttps://llama.app/ Been using llama.cpp for years now and im on here all the time (im a mod..), but somehow I totally missed that llama.app exists and its official from the HF/llama.cpp team. So posti→3 Aug 2026I benchmarked classic vector RAG vs Google's new OKF format vs both combined — same corpus, same 7 questions, all local (Ollama + ChromaDB)Google Cloud published OKF (Open Knowledge Format) on June 12th — a spec for storing curated knowledge as a directory of markdown files with YAML frontmatter. One concept per file, linked to each othe→10 Aug 2026Need real world ML problems to evaluate my educational ML toolsI'm a retired platform engineer, coding mainly in Rust, and involved with a ML study group. I developed a ML programming language (alternative to Python, Colab) to help me learn (and teach) ML concept→10 Aug 2026Introducing Muse Glimmer: an open-weight model optimized for always-on local agent workflowsHi r/LocalLLaMA 👋 Today we’re excited to release Muse Glimmer, a 30B open-weight model built specifically for local agent workflows. We’re releasing the weights to the community under a permissive Apa→10 Aug 2026Best open-source harness like Claude Code?Avid claude code user here looking to do equivalent things with local models. Just want to plug in something like Qwen and have the interface be 1:1 with claude code. Any suggestion? submitted by /u/N
ToolHugging Face8 recent entries10 Aug 2026Native Long Video Understanding Models locally?I've been building a personal project and wanted to check with the community on multi-modal inputs since I can't find a lot of material around this online. Ultimately I'm trying to build something tha→10 Aug 2026Introducing Muse Glimmer: an open-weight model optimized for always-on local agent workflowsHi r/LocalLLaMA 👋 Today we’re excited to release Muse Glimmer, a 30B open-weight model built specifically for local agent workflows. We’re releasing the weights to the community under a permissive Apa→10 Aug 2026inclusionAI/Ling-3.0-tiny · 8B A1.3B MoE· Hugging FaceLooks like the Ling team open weighted a much smaller version of the Ling-3.0-flash they open weighted a few days ago. It's 8B params with 1.3B active, and seems to fall between the 4B and 8-12B Qwen →10 Aug 2026I trained a 1B-parameter LLM from scratch on 20B tokens for about $200A few months ago, I had the idea of making a LLM from scratch as a personal project (for learning and partly for improving my resume). Since I learned a lot from other posts on here over the past year→11 Aug 2026Toy project: a chat title model that fits in 5 MiB of ramNot even sure if I'm allowed to post this, what with the 'completely/primarily LLM generated copy' rule (the post itself is fine, but the repo/model I'm sharing definitely is, whoops) and the whole li→11 Aug 2026Luth-2: New State-of-the-Art French Small Language ModelsHey everyone, Today we release Luth-2-0.8B and Luth2-2-2B, two non-reasoning models that set a new state of the art for French across a wide variety of tasks for their size 🚀 A few notable scores on F→12 Aug 2026Qwen 3.8 2.4T is out , no 27b today RIP.i was hoping they would release both today but the big one just dropped now , and it says its been listed since 5 hours ago on huggingface. I guess the real date for 27b is https://modelscope.cn/model→12 Aug 2026LiquidAI/LFM2.5-VL-3B · Hugging FaceLFM2.5-VL-3B is a multimodal variant of LFM2.5, a family of hybrid models designed for on-device deployment. It builds on LFM2-VL-3B with further mid- and post-training. LFM2.5-VL-3B can process both