CompanyAnthropic4 recent entries27 Jul 2026Give any Ollama-compatible client session memory + a shared knowledge wiki by swapping the chat URLHey folks — I built ContextMemory, an open-source agentic context gateway for apps that already talk to LLMs. The idea is simple: keep your existing POST /api/chat client (Ollama wire format), point i→5 Aug 2026DeepSeek V4 Flash 0731 at 10–17 t/s (nothink) on MacBook M5 Pro **64GB***, partly via SSD streamingInspired by a post from u/giveen I motivated claude (no patinence on my side to work through everything myself) to help me get DS running on my MacBook M5 Pro 64GB and it exceeded my expectations.. be
CompanyOpenAI3 recent entries27 Jul 2026Give any Ollama-compatible client session memory + a shared knowledge wiki by swapping the chat URLHey folks — I built ContextMemory, an open-source agentic context gateway for apps that already talk to LLMs. The idea is simple: keep your existing POST /api/chat client (Ollama wire format), point i→28 Aug 2026Self-hosted agent + BI platform that runs fully local, Ollama or vLLM for both chat and embeddingsBeen building AgentSwarms for a while. Agent platform with RAG, multi-agent workflows and a BI layer over your own data. Posting here because the whole thing runs without a single hosted API if you wa→1 Oct 2026Built an SQLite-based memory system for Ollama that doesn't eat all your VRAMWanted to share a project I've been working on to give local Ollama models persistent document memory without needing heavy vector databases. It's called Hillock. The main problem I had with standard
CompanyMeta3 recent entries6 Sept 2026DeepSeek-V4-Flash-Vision Q8 vs Qwen3.8-Flash-Next Q8I'm using DS-V4-Flash-Vision with Q8_K_XL quantization locally as my everyday engine, and for some time now I've been doing a lot of comparisons with Qwen3.8-Flash-Next, also with Q8_K_XL quantization→12 Sept 2026Nex-N2.5-mini-MLX-4bit on Apple M5 Max — 133.6 tok/s — llm-bench.ioAnother new model dropped in the course of this week that is well deployable on consumer hardware: Nex N2.5 Mini I went with the recommended settings for the best generation quality and ran a few benc→1 Oct 2026Built an SQLite-based memory system for Ollama that doesn't eat all your VRAMWanted to share a project I've been working on to give local Ollama models persistent document memory without needing heavy vector databases. It's called Hillock. The main problem I had with standard
CompanyMistral1 recent entries11 Sept 2026Detecting hallucinations in local models without eating VRAM: What we learned testing 1.5B to 120B modelsHey everyone, If you run local models via Ollama in production or personal projects, you've probably run into the hallucination problem: how do you know when a model is hallucinating without burning e
CompanyDeepSeek8 recent entries6 Sept 2026DeepSeek-V4-Flash-Vision Q8 vs Qwen3.8-Flash-Next Q8I'm using DS-V4-Flash-Vision with Q8_K_XL quantization locally as my everyday engine, and for some time now I've been doing a lot of comparisons with Qwen3.8-Flash-Next, also with Q8_K_XL quantization→9 Sept 2026GLM 5.3 Flash Q4 @ 60tps / 550tps on M3 UltraI have been a dwarfstar fan for awhile and I really liked glm 5.3 flash but needed it to be materially faster to feel good using it. In the screenshot you can see the outcome of using the model with a→11 Sept 2026Detecting hallucinations in local models without eating VRAM: What we learned testing 1.5B to 120B modelsHey everyone, If you run local models via Ollama in production or personal projects, you've probably run into the hallucination problem: how do you know when a model is hallucinating without burning e→12 Sept 2026Nex-N2.5-mini-MLX-4bit on Apple M5 Max — 133.6 tok/s — llm-bench.ioAnother new model dropped in the course of this week that is well deployable on consumer hardware: Nex N2.5 Mini I went with the recommended settings for the best generation quality and ran a few benc→27 Sept 2026Worth going from Qwen3.8 27B to flash next or maaybe deepseek v4 flash?I am running qwen3.8 27b on my dual rtx 3090 (fp8 quant, unquantized cache, 129k context) and I think it works decently well with hermes, opencode etc. But! I am tempted by the new models coming out s→4 Oct 2026For dual DGX spark users; GLM 5.3 flash got a 50%+ performance boostFor the last few months, I ran DeepSeek v4.0 flash (NVFP4). First 0731, then visionexp because it was a free improvement. I got around 65 tps decode and almost 2k prefill, and ran 4-5 agents in parall→8 Oct 2026Open sourcing Game Summoner, my prompt to game sitetldr: Open sourced my prompt to game suite: https://github.com/ndamiano/ai-agent-test, it's MIT licensed, and this runs well on my 5090 with 64gb ram, but any model that can handle tool calls can mana→9 Oct 2026Just another purely open-weight models benchmarkLive results, coding benchmarks included, agentic benchmarks included, domains and other classifications filters included. (Spoiler: DeepSeek-V4-Vision-Exp rules, but other models have their rule area
CompanyNVIDIA3 recent entries3 Aug 2026'Data center in a Box (on Wheels)' 256Gb VRAM/512Gb RAM AI Server 6-8 Month Operational Review, Stability Write Up, BenchmarksI've been out of these forums for awhile but I figured I would provide a formal update on how this has been going now that it has some operation time under its belt, just to put the information out th→9 Aug 2026DeepSeek v4 Flash 0731 locally on CPUAfter seeing the benchmark results for the full release of DS v4 Flash 0731, I replaced my 2 x 16GB DDR4 ram sticks with 2 x 32GB DDR4 ram sticks to get a max supported of 128 GB RAM, in hope to be ab→9 Oct 2026Just another purely open-weight models benchmarkLive results, coding benchmarks included, agentic benchmarks included, domains and other classifications filters included. (Spoiler: DeepSeek-V4-Vision-Exp rules, but other models have their rule area