CompanyAnthropic2 recent entries30 Aug 2026Experience report - Qwen 3.8 Flash Next on memory rich, GPU poor setup(not written by Claude, all errors and crappy text are result of too little coffee on a Sunday morning ;) Our home server is a 2018 Thinkstation P520, bought for about 600eur in 2023. It's been upgrad→31 Aug 2026Doesn't this look like NVIDIA is price fixing?According to this article Samsung has locked up the 70% of it's future ram production in contracts to companies like Microsoft, Google, and Nvidia. Everyone knows this is driving the ram price increas
CompanyGoogle3 recent entries17 Aug 2026pagedMark: invisible SynthID-class watermark removal for AI images (ChatGPT, gpt-image, DALL·E, Sora, Gemini, Nano Banana), running on MetalpagedMark removes AI provenance from content you generated yourself. Two different things, and it is worth separating them. The first is metadata: C2PA Content Credentials, EXIF, XMP, IPTC, the genera→16 Sept 2026Ministral 3 3B on a Galaxy S21 relayed a conversation between Gemini and Z.ai across Chrome and FirefoxA follow-up to my earlier post about small models on phones. Last time it was fixed tasks in a single browser. This is something else. Ministral 3 3B Q4_K_M in llama.cpp on a Samsung Galaxy S21, four →7 Oct 2026A stock GLM-Edge-1.5B-Chat on a 4GB Galaxy A04e completed a real Amazon cart taskYesterday TechCrunch published a piece about a growing problem for AI agents: websites are starting to block them. Amazon blocking Meta's Muse is the obvious example. At almost exactly the same time,
CompanyMeta5 recent entries10 Aug 2026Needle 2: 14MB agentic LLM for phones, wearables, smart home and robots.Hey LocalLlaMa, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots a→30 Aug 2026Experience report - Qwen 3.8 Flash Next on memory rich, GPU poor setup(not written by Claude, all errors and crappy text are result of too little coffee on a Sunday morning ;) Our home server is a 2018 Thinkstation P520, bought for about 600eur in 2023. It's been upgrad→8 Sept 2026Qwen3-0.6B (400 MB) on a Samsung Note 8 (2017) phone drives a real desktop ChromeUp front: I'm one of the people building the page-perception layer used here. We started by testing small local models. The result turned out to be more interesting than the original test. 12 small mo→6 Oct 2026[Benchmark] Running Local LLMs on Orange Pi 5 Plus (RK3588, 16GB): Ollama Tok/s, NPU Offloading, Core Pinning & ThermalsDisclosure: This unit was provided free of charge by Orange Pi for testing. No editorial review, no preconditions, no script. All data, bottlenecks, and thermal behavior are reported directly from har→7 Oct 2026A stock GLM-Edge-1.5B-Chat on a 4GB Galaxy A04e completed a real Amazon cart taskYesterday TechCrunch published a piece about a growing problem for AI agents: websites are starting to block them. Amazon blocking Meta's Muse is the obvious example. At almost exactly the same time,
CompanyDeepSeek4 recent entries25 Aug 2026Spent a day seeing how far extreme MoE models can be pushed on a 4070 Ti + 32GB RAM. Kimi K3, DeepSeek V4 Flash, and Qwen3.5-122B results + research paper🔧I’ve been experimenting with a custom inference/runtime research project called CRANE V2, mostly because I wanted to answer a stupid question: How far can you push absurdly large MoE models on an ordi→30 Aug 2026Experience report - Qwen 3.8 Flash Next on memory rich, GPU poor setup(not written by Claude, all errors and crappy text are result of too little coffee on a Sunday morning ;) Our home server is a 2018 Thinkstation P520, bought for about 600eur in 2023. It's been upgrad→13 Sept 2026Benchmark your custom Pi toolsA few people here mentioned interest in a way to test their custom Pi setups, so I figured I’d drop this here: RoastMyHarness The basic idea is a small engine that sets up an environment to run DeepSW→6 Oct 2026[Benchmark] Running Local LLMs on Orange Pi 5 Plus (RK3588, 16GB): Ollama Tok/s, NPU Offloading, Core Pinning & ThermalsDisclosure: This unit was provided free of charge by Orange Pi for testing. No editorial review, no preconditions, no script. All data, bottlenecks, and thermal behavior are reported directly from har
CompanyNVIDIA4 recent entries12 Apr 2026[D] Will Google’s TurboQuant algorithm hurt AI demand for memory chips? [D]This r/MachineLearning discussion centers on Google's TurboQuant, a training-free KV cache compression algorithm released in March 2026 that compresses cache storage from 16 bits down to 3 bits with m→31 Aug 2026Doesn't this look like NVIDIA is price fixing?According to this article Samsung has locked up the 70% of it's future ram production in contracts to companies like Microsoft, Google, and Nvidia. Everyone knows this is driving the ram price increas→13 Sept 20263k$ 128GB VRAM + 256GB RAM DDR4 ServerI finished my home inference server. First I tried Lenovo p620 workstation and while it’s a good value overall it pissed me off with a ton of proprietary Lenovo shit to deal with and I return it in th→20 Sept 2026RTX 5090 random black screen + 100% fans + hard lock; sometimes no POST until AC power is removed — gaming, ComfyUI and OllamaRTX 5090 random black screen + 100% fans + hard lock; sometimes no POST until AC power is removed — gaming, ComfyUI and Ollama I am looking for help diagnosing a very intermittent but increasingly fre