CompanyAnthropic8 recent entries26 Aug 2026OpenCode with Qwen3.8-27B for Small Games or Browsing the Web With 16GB VRAMIn the past, I have use llama.cpp, but I read that the exl3 quantization format should give better precision, so I have tried exllamav3/tabbyAPI. It was able to write the shown simple HTML game withou→27 Aug 2026What are the most frustrating silent failures you've encountered with local LLMs?I've been building a small tool opensource project that sits between applications and local LLM servers (starting with Ollama) to diagnose silent inference failures instead of just showing logs. Thing
CompanyOpenAI8 recent entries18 Sept 2026Having ChatGPT help me navigate my employment situation has me feeling some kind of strange emotional attachment to it.I'm sure I'm the 1000th person to make a post like this, but I've always been pretty skeptical of AI, and I've always had trust issues and have been very hesitant to talk about my struggles to friends→19 Sept 2026What is the best way to use LLMS's in 2026? I feel like a caveman with the way I use them?I'm still using LLM's the 2022/23 way of doing everything manually from the chat box. I copy and paste everything manually into the box and ask the AI to explain or do something, such as pasting code →20 Sept 2026An Open Letter to OpenAI: Please Don’t Eliminate Custom GPTs Until You Have a REAL ReplacementOpenAI’s decision to retire custom GPTs appears to rest on the assumption that Plugins, Skills, Projects, Apps, and Workspace Agents collectively replace their functionality. For many Small and Medium→21 Sept 2026It started with a simple question... 'How can I give my brother independence again?'Hey everyone, I wanted to share a story that changed my perspective on what's possible with modern AI tools, especially for everyday people with no background in software development. My brother Ben h→2 Oct 2026I've ended up with an AI lab in a public community college. What should we actually be teaching?Looking for some ideas from people who know a lot more about this than I do. We've got funding for a small AI lab in a public further education college in Ireland (roughly community college in the US)→3 Oct 2026A Meta-Prompt for YuE2I've come up with a meta-prompt for generating YuE2 prompts that seems to work pretty well. Copy-paste into an LLM (it should have internet searching capabilities, I mostly just use ChatGPT). Just to →8 Oct 2026chatgpt's new intelligent ui was reverse engineered in less than 24 hours, and apparently you can recreate it with local llmscame across a pretty interesting technical breakdown of chatgpt's newly launched 'intelligent ui' feature, and thought this subreddit might find it interesting. for anyone unfamiliar with the concept,→10 Oct 2026Engineer / developer observations of Gemma4-31B, Qwen3.8-27B, and 6.1-Sol for software engineering workFor what it's worth. I'm a mechanical engineer by education and software engineer in practice over the past ~20 years. Playing around with local models has been a recent hobby. Today I decided to do a
CompanyGoogle8 recent entries15 Apr 2026How much harder is it these days to get into a PhD program without having a high ranking degree for UG? [D]This Reddit discussion thread from r/MachineLearning explores the growing challenges faced by applicants from non-elite undergraduate institutions when applying to PhD programs in machine learning and→16 Apr 2026Google’s DeepMind just released new 4B and 27B MedGemma models!Google DeepMind released MedGemma, a collection of medical vision-language foundation models based on Gemma 3 in 4B and 27B parameter sizes, demonstrating advanced medical understanding and reasoning →5 May 2026I asked ChatGPT and Gemini to do this weird perspective portrait with my face. I gave it a front face picture and a profile, including the example artwork. That was the result.This post documents a user's experiment comparing ChatGPT and Gemini's ability to create perspective portrait artwork using two reference images (a front-facing photo and a profile photo) along with a→22 Jul 2026Cactus Hybrid: We taught Gemma 4 to know when it's wrongHey HN, Henry & Roman here from Cactus. A small, on-device model is fast and private, but sometimes wrong, but frontier models are getting expensive pretty fast. So, we post-trained Gemma 4 E2B post-t→16 Sept 2026Write up on building and improving reliability of agentic harnesses + a big dataset from my work.I've been working on something for this community (and other self-hosted communities) for almost 5 months now. Personally, I would grade it as probably the closest open source equivalent of Manus and →27 Sept 2026Qwen, where's the small stuff? (1B/2B/4B)I know Qwen is a key player in the local LLM space and has consistently introduced truly impactful technologies—like n-gram in Qwen-Next and the recent Qwen 3.8 27B, which is an amazing local model. H→6 Oct 2026Introducing EmbeddingGemma 2: A best-in-class open model for natively multimodal embeddings | Googlehttps://huggingface.co/google/embeddinggemma-2 EmbeddingGemma 2 is an open multimodal embedding model built by Google DeepMind which maps text (incl. code), images, video, and audio inputs—and combina→6 Oct 2026google/embeddinggemma-2 · Hugging FaceEmbeddingGemma 2 is an open multimodal embedding model built by Google DeepMind which maps text (incl. code), images, video, and audio inputs—and combinations thereof—into a single, unified 768-dimens
CompanyMeta7 recent entries14 Apr 2026Agents in Ollama and LangflowThis Reddit post from r/ollama likely discusses how to build and run AI agents locally by combining Ollama — which handles local model serving to keep data private — with Langflow's visual, drag-and-d→1 May 2026Need suggestions for Rag modelA Reddit discussion in the r/ollama community seeking recommendations for RAG (Retrieval-Augmented Generation) models, likely addressing model selection for local LLM-based document retrieval systems.→25 Jul 2026Benchmarks: TensorSharp vs. llama.cppCuda and Vulkan Benchmark: TensorSharp vs. llama.cpp I would like to share my latest open source local Unsloth (GGUF) LLM inference engine and applications. It supports many models from Unsloth, like →30 Jul 2026P.A.I. — Sleek Native Desktop AI Overlayer for Local Ollama Models 🤖⚡Greetings Community! 👋 I hope everyone is doing well! I'm Tauhid — Senior EEE student from a Bangladeshi University Today I'd like to share an open-source project I’ve been developing called P.A.I. (P→30 Jul 2026Mechanistic interpretability streamlined for everyday users like us😎 🧠Context: I want to give the community an Open Research (well open under Apache 2.0 clause) - tool that allows everyday users like us to look deeper into the local models we use consistently. Mechanist→3 Sept 2026Testing Deepseek-V4-Flash-Vision-EXP on Dual RTX6000 buildUpgraded my work LLM server from DSV4-Flash-0731 to the new Vision-Exp model and did this little test for fun to see quality comparison. Test was performed in Openweb UI connected to my vLLM container→8 Oct 2026chatgpt's new intelligent ui was reverse engineered in less than 24 hours, and apparently you can recreate it with local llmscame across a pretty interesting technical breakdown of chatgpt's newly launched 'intelligent ui' feature, and thought this subreddit might find it interesting. for anyone unfamiliar with the concept,
CompanyMistral2 recent entries14 Apr 2026Agents in Ollama and LangflowThis Reddit post from r/ollama likely discusses how to build and run AI agents locally by combining Ollama — which handles local model serving to keep data private — with Langflow's visual, drag-and-d→6 Aug 2026nvidia/NVIDIA-Nemotron-Parse-2.0 · Hugging FaceNVIDIA Nemotron Parse 2.0 transforms document images into structured, machine-readable representations with text, layout classes, bounding boxes, and reading-order information. Given a Red, Green, Blu
CompanyxAI2 recent entries5 May 2026Parllama -- a terminal UI for Ollama model management and multi-provider LLM chatParllama is a TUI (Text UI) application designed for easy management and use of Ollama-based LLMs that also works with major cloud-provided LLMs. It provides core model management features including f→19 Sept 2026What is the best way to use LLMS's in 2026? I feel like a caveman with the way I use them?I'm still using LLM's the 2022/23 way of doing everything manually from the chat box. I copy and paste everything manually into the box and ask the AI to explain or do something, such as pasting code
CompanyDeepSeek8 recent entries5 Aug 2026Qwen Developers' responses from their recent Twitter/X AMAQuestions & Responses(in BOLD) below. Favorite question(s) moved to end of the thread with combined responses(removed duplicates). Be optimistic folks. I'm sure we're getting other models too apart fr→10 Aug 2026DeepSeek V4 Flash 0731 is the ‘killer app’ that is going to sell A LOT of DGX SparksHaving a ‘Killer Application’ that everyone wants to use helps sell hardware, plain and simple. DeepSeek V4 Flash 0731 isn’t an app of course, but I think it’s going to be the major catalyst for getti→11 Aug 2026I gave DeepSeek V4 Flash basic vision by training a 40M connector on 100K examplesI wanted to find out whether a huge text-only MoE could be given basic vision without retraining the language model itself. The short answer is yes. I froze DeepSeek V4 Flash and a 417M-parameter Moon→20 Aug 2026The boring way to run Deepseek V4 Flash-0731 130-150 tks - 16x5060ti 16GB over 2 PLX88096 switchesComponent Validated configuration Motherboard ASRock Rack SPC621D8U-2T/OVH CPU Xeon Gold 6330 (Get gold/platinum if interested in Optane Pmem gimmicks) GPU fabric Two Broadcom/PLX PEX88096 islands, ei→25 Aug 2026Spent a day seeing how far extreme MoE models can be pushed on a 4070 Ti + 32GB RAM. Kimi K3, DeepSeek V4 Flash, and Qwen3.5-122B results + research paper🔧I’ve been experimenting with a custom inference/runtime research project called CRANE V2, mostly because I wanted to answer a stupid question: How far can you push absurdly large MoE models on an ordi→3 Sept 2026Testing Deepseek-V4-Flash-Vision-EXP on Dual RTX6000 buildUpgraded my work LLM server from DSV4-Flash-0731 to the new Vision-Exp model and did this little test for fun to see quality comparison. Test was performed in Openweb UI connected to my vLLM container→2 Oct 2026Two 96 GB Ascend cards crun Qwen3.8-flash-next hardware notes, vLLM work, benchmarks, and what is nextI have been building a somewhat unusual local inference machine around two Huawei Atlas 300I Duo cards. They are relatively inexpensive, passive, dual-accelerator PCIe cards with 96 GB of device memor→8 Oct 2026Running an LLM-driven town with 800+ persistent agents: concurrency, context caching, and inference costsI spent the past year independently building Slow Vale, an LLM-driven life simulation. The Chinese server now has 800+ AI residents sharing one continuously running city. This is an engineering write-
CompanyNVIDIA8 recent entries10 Aug 2026DeepSeek V4 Flash 0731 is the ‘killer app’ that is going to sell A LOT of DGX SparksHaving a ‘Killer Application’ that everyone wants to use helps sell hardware, plain and simple. DeepSeek V4 Flash 0731 isn’t an app of course, but I think it’s going to be the major catalyst for getti→12 Aug 2026LiquidAI/LFM2.5-VL-3B · Hugging FaceLFM2.5-VL-3B is a multimodal variant of LFM2.5, a family of hybrid models designed for on-device deployment. It builds on LFM2-VL-3B with further mid- and post-training. LFM2.5-VL-3B can process both →20 Aug 2026The boring way to run Deepseek V4 Flash-0731 130-150 tks - 16x5060ti 16GB over 2 PLX88096 switchesComponent Validated configuration Motherboard ASRock Rack SPC621D8U-2T/OVH CPU Xeon Gold 6330 (Get gold/platinum if interested in Optane Pmem gimmicks) GPU fabric Two Broadcom/PLX PEX88096 islands, ei→26 Aug 2026OpenCode with Qwen3.8-27B for Small Games or Browsing the Web With 16GB VRAMIn the past, I have use llama.cpp, but I read that the exl3 quantization format should give better precision, so I have tried exllamav3/tabbyAPI. It was able to write the shown simple HTML game withou→2 Sept 2026VoxGen, an AMD-optimized TTS inference engine for VoxCPM 2 modelsHi, everyone, I’ve just released VoxGen, a lightweight native inference engine for VoxCPM2, written in Rust and using Vulkan compute instead of Python/PyTorch/CUDA. Why VoxGen? The main reason I start→20 Sept 2026RTX 5090 random black screen + 100% fans + hard lock; sometimes no POST until AC power is removed — gaming, ComfyUI and OllamaRTX 5090 random black screen + 100% fans + hard lock; sometimes no POST until AC power is removed — gaming, ComfyUI and Ollama I am looking for help diagnosing a very intermittent but increasingly fre→2 Oct 2026Two 96 GB Ascend cards crun Qwen3.8-flash-next hardware notes, vLLM work, benchmarks, and what is nextI have been building a somewhat unusual local inference machine around two Huawei Atlas 300I Duo cards. They are relatively inexpensive, passive, dual-accelerator PCIe cards with 96 GB of device memor→11 Oct 2026I trained a 102M recursive BitNet-v2 model from scratch: 64K context, trained on less than 5B tokensDISCLAIMER: the post and the model card was made with the assist of AI. Hiya, I’m releasing Recursive BitNet N-Gram 102M, a small experiment combining ternary weights, shared transformer layers, and h