All entries

RSI is not happening [R]

model-releasesr-machinelearning

A new paper (I'm not a coauthor BTW -- I just found it interesting) argues, basically, that RSI1 is not on the horizon2, because current (at the time the study was done) agents cannot do open-ended ML

Running Qwen 3.8 next on 16vram+32ram - A useful/fun post for the gpu poors

4,782

Source

Human DGX agent

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

DGX agent

Hello Reddit. Posting this for fun. I thought it was a lonely and silly journey to set up Qwen 3.8 Next on a system that doesn't really run it properly—it was a challenge that might help the community

model-releasesr-localllama

14 Sept 2026

Running Qwen3.8-Flash-Next locally on a 12GB VRAM card

Now that the dust has settled a bit - here's a write-up on running Qwen3.8-Flash-Next (125B-A6B MoE + 51B n-gram table) on relatively middle-tier hardware (RTX 4070 12GB + 64GB DDR5-5600 + Gen4 NVMe o

Tutorial For Installing Sage and Triton to ComfyUI Portable. Gave Me A 40% Speed Boost On Minimax H3 4-Step Workflow

model-releasesr-stablediffusion

I know Sage and Triton are nothing new but if you're a beginner or doing a fresh re-install like me, these resources helped me get faster gens on the 4-step turbo workflow I use (will post a link to t

UkisAI Swift-Qwen3.8-27B / -58.3% thinking, x1.95 speed while keeping the accuracy of xhigh

Hi everybody, we post-trained Qwen 3.8 27B to be more efficient by figuring out which tokens were linked to overthinking and penalizing them without 'attacking' the reasoning length directly then fixe

What are the current best retail GPUs for max VRAM at a reasonable price?

I am considering dumping my ChatGPT Plus subscription and go full local, but to do so I would first need to reach a decent result for quality (and reasonable speed). My 4090 fried itself out of nowher

3k$ 128GB VRAM + 256GB RAM DDR4 Server

I finished my home inference server. First I tried Lenovo p620 workstation and while it’s a good value overall it pissed me off with a ton of proprietary Lenovo shit to deal with and I return it in th

Are there any experimental small models (9B or less) which are out or currently being trained using engram/n-grams?

Not sure if anyone out there is working on this, don't see any on huggingface to try out. It might be too new at the moment, but it would be cool to see the difference between a tiny model trained wit

Aurora1.0-150M Releases!

The first generation of our 150M model has just been released Its performance is similar to that of GPT2-Small The benchmarks: PIQA: 62.24% Hellaswag: 32.20% Arc-Easy: 44.91% Arc-Challenge: 25.00% Ari

Benchmark your custom Pi tools

A few people here mentioned interest in a way to test their custom Pi setups, so I figured I’d drop this here: RoastMyHarness The basic idea is a small engine that sets up an environment to run DeepSW

Build around cmp 170hx for qwen flash next

Don't upvote, just looking for CPU ram options for running qwen flash next, and maybe larger models (so maybe between 128 and 256gb total ram) with an existing cmp 170hx. Use case is agentic coding so

Dear 24G owners, try VLLM you might be able to run Qwen3.8 27B INT4, 144K FP8 KV on RTX 3090 with better speed. (TLDR VLLM AOT)

VLLM Benchmark: Prefill, Prompt processing - avg, 871.93 tok/s (3 hours constant running xhigh) - 10K prompt, 1000.26 tok/s (16 runs) - 90K prompt, 743,59 tok/s (16 runs) Decode, tok gen - avg, 38.39

DS 4.1 and the new Harness

I gave DS V4.1 Flash an HLE problem with a bash tool + 2 hours. Hour 1: it wrote three MILP solvers. (225,200) Hour 2: it downloaded the HLE dataset from Hugging Face, found the question, read the ans

Industry

Experiment

Want to help me with a tiny ChatGPT experiment? I stumbled onto something interesting after seeing how differently ChatGPT users got responses to the exact same underspecified prompt, and now I’m curi

industryr-chatgpt

Hoping for Optimized Smarter Upcoming Models .... Like DeepSeek-V4.1-Flash( KVCache + Engram) in Small/Medium/Big sizes

It's still a dream for many folks to run medium size(30B range) models @ Q8 with Unquantized KVCache (256K Context) on their GPUs. It would be awesome to have DeepSeek-V4.1-Flash's KVCache + Engram fo

Horse racing as an ML ranking problem: 1.18M runners, walk-forward validation and a very strong market baseline [D]

model-releasesr-machinelearning

Hi 👋 long time lurker It’s been a few years since the last post about Horse Racing within this sub. A few years ago I was reading a popular science book and came across the story Bill Benter and the s

How does Qwen 3.8 27B compare on low thinking mode to the older 3.6 models?

Since we know Qwen 3.8 27B thinks quite long, but gives at least a good one-shot result where you can leave it to do everything on it own, how does it compare to the older series of models for very si

I built a serverless hosting platform for LoRA adapters with vLLM

It’s always bothered me that after fine-tuning a model for a project, there isn’t a particularly easy way to host it without either running it locally and keeping a GPU on 24/7 or paying for an entire

I end every AI session with two questions

One is from Sam Altman, the other Claude suggested and it works extremely well. The first question I ask: What are you least confident about right now. The AI will list like 6 to 7 things that it didn

model-releasesr-chatgpt

I have just moved from MacBook M5 pro 48 GB to RTX3090

Using the RTX3090 on a linux machine I built for it and running Qwen 3.8 27B getting average 100t/s compared to my MacBook 20t/s I think I can finally get rid of my Claude subscription, this is good e

Illustrious Lora required for this artstyle

model-releasesr-stablediffusion

Hey guy, does anyone know how to replicate this artstyle, i have tried finding lora on civitai, took help from claude and chatgpt but i am unable to recreate this. submitted by /u/Negative-Rise-9250 [

internlm/Intern-S2 · Hugging Face

from internlm: We introduce Intern-S2-397B, our most capable multimodal foundation model for scientific intelligence and long-horizon agents. Intern-S2-397B scales along three critical dimensions: pre

Is there still strong interest in a dense 9b model?

I have a full model, it's ready to train. It's ~9b parameters. 9.4b to be more exact. That includes a 1/2/3 Engram table, Moonshot's AttnRes modeling, and RoPE / NoPE layering at 3:1 as more or less v

llm performance community metric

my question about LLM performance We see a lot of posts about token prediction, token generation per second, etc. But is it really the metric? I can see that DeepSeek V4 Flash 0731 (with DSPark; mac s

Migration from Claude Code to a private local harness. Questions.

I'll start by saying I'm not talking about the models themselves, I'm aware that I can't come close to something like Fable's intelligence locally. Just wanted to get that out of the way. Basically. O

My experience building 64GB VRAM AI SWE assistant/agent PC

As a SWE I have ultimate belief that having a irreplaceable subscription on OpenAI and Anthropic models is actually against my beliefs (I'm not fond of becoming a digital slave and being unable to do

Qwen 3.8 27B UD-IQ4_XS even faster on 16GB CUDA

This is an evolution on top of Raymond's KV cache streaming fork - all credits to what enabled this goes to him. The basic idea behind what he enabled was a pool of memory in VRAM that is used differe

Qwen 3.8 flash with Ollama

Hi All. Just tried to down the NVFP4 version from Ollama but it’s the MLX!? Anyone else been able to access this version? Only have 1 DGX so wanted the smaller footprint for user with Hermes. Any sugg

Qwen3.8 flash next - untrained svg generation

> 'make an svg of a frog playing on a chello on the back of a whale with carribean island in the back.' interestingly the svg looks different in the OpenWebUi preview then when looked at in preview (o

ROCm 7.2.1 + llama.cpp on mixed Vega GPUs (gfx900 Vega64 + gfx906 MI50) — got 52-57 tok/s on Gemma 3 27B Q4 with patched rocBLAS payloads [repo + Dockerfile]

I'm documenting a reproducible setup for running current llama.cpp on a mixed AMD Vega system with both: Radeon RX Vega 64 / Vega10 / gfx900 (8GB HBM2) Radeon Instinct MI50 (Vega20) / gfx906 (16GB HBM

Rumik OSS 1 - 3B parameters TTS model focused on Indian Languages

local-air-stablediffusion

Just stumbled upon this. Seems to be a new 3B TTS model mainly focused on Indian languages (22 Indic languages + English). Apparently supports code-switching, romanized text, emotion/delivery control

Style transfer capabilities of different open-source methods 2026 Update

model-releasesr-stablediffusion

Style transfer capabilities of different open-source methods 2026 Update This is the updated version of the study published at 2025.09.12. Link: https://www.reddit.com/r/StableDiffusion/comments/1nfoz

Swarm inference AI

I’m developing this https://swarm.dafonet.com If someone want to collaborate? I’m looking for people with capabilities to test it in different infraestructures. Best regards Gabriel Giani submitted by

local-air-ollama

TaoMate H3 3 Step LoRA now working in ComfyUI

local-air-stablediffusion

For anyone using MiniMax H3 in ComfyUI I made the official TaoMate H3 3 Step LoRA available in a ComfyUI compatible safetensors format. No retraining, no merge, no extra fine tuning. The model itself

The Local LLM community feels like the golden era of the internet all over again

Lately because of the current hardware shortage, unfortunately or fortunately, we can’t just throw infinite cloud compute at our problems, but we’re forced to actually care about what’s happening unde

The rhetoric is really heating up!

The entire page of the NY Times today above the fold absent one article is AI (the models are just too strong/too dangerous, must be regulated). They forgot to include 'Sponsored by OpenAI' at the end

Agents

[Upcoming AMA] Waymo AI Team AMA – Drop Your Questions Early! [D]

EDIT: Thanks from the Waymo AI Team! A huge thank you to the r/MachineLearning community for all the thoughtful, deep-dive questions today. If you want to dive deeper into our technical research, chec

agentsr-machinelearning

What happens when an AI agent gets tricked into stealing AWS keys? (Full walkthrough of our local fail-closed defense)

Hey everyone, Giving AI agents access to MCP tools or shell commands is awesome, but prompt injection is still a huge headache. If an agent reads an untrusted document containing `ignore previous inst

Research

Zachery Lipton: 'CS academia broke the system...perhaps all that it takes for the system to rebuild is for it to burn to the ground' [D]

researchr-machinelearning

Sept 9, 2026 hits an all time daily high of 447 new machine learning papers uploaded to cs.LG (https://arxiv.org/list/cs.LG/recent?skip=0&show=500). This is many times more papers than what a human be

2×RTX 3090 + EPYC box running qwen3.8-flash-next at ~38 tok/s

What I have: - CPU: EPYC 7551 (32c/64T, Zen 1) - Board: Supermicro H11SSL-i (SP3), Rev 2.0 - RAM: 128 GB DDR4-2133 (all 8 channels full) - GPU: 2x RTX 3090 (48 GB total, PCIe 3.0) - 1500 W PSU What I

3.8-27B has ruined 3.5/3.6-35B’s for me. It’s just absurdly superior.

Applied science work, from workflow design, data pipeline, results analysis, article/reports writing and data publishing online. 5 projects I did in the past replicated from start to finish. 3x to 4x

52 knobs, 72 hours, one compiled Rust model: Catalyst told an AI agent what actually mattered in 1.37s and verified every answer

I’ve been building Catalyst around a capability I want engineering agents to have: An AI agent can read a program and make a good guess about what matters. Catalyst lets it measure what actually matte

Agnes-AI/Agnes-3.0-Flash 33B Multimodal, AA score: 36

I find this new model at HF: 'Built for demanding work. A 262 144-token context window, adjustable reasoning effort, tool calling, and text, image and video understanding. Architecture Agnes-3.0-Flash

Antirez Deepseek 4.1 flash gguf on HF

Q2 is there and Q4 is uploading as I type. Has his github been updated yet? How do you run this? https://huggingface.co/antirez/deepseek-v4.1-flash-gguf/tree/main submitted by /u/Queasy_Asparagus69 [l

Anybody use frontier models like Astra/Fable for planning/judging, and qwen3.8 as the main workhorse? Curious to hear about your setups!

Hey everyone! I'm curious to hear from people that use a combination of cloud-based frontier models and local ones for development. I'm planning to set something similar up and wanted to hear about ac

bartowski/Qwen3.8-27B-GGUF · Hugging Face - Updated (Per-tensor layout)

Blog Post : Per-tensor layout maps for GGUF quantization Reddit thread : New tensor type layouts for my GGUF uploads EDIT : Model card has updated things such as Graph, table, text, etc., submitted by

Best AI subscription for the dollar? What’s the best to spend on? ChatGPT or Claude or Gemini?

I’ve been researching which models to sub to and I’m currently not subbed to anything. I’ve definitely searched here and other places for opinions but a lot of what I was reading wasn’t current or 6mo

model-releasesr-chatgpt

Bye Claude, you've reached my token limit

January 2025 I made the switch from OpenAI to Claude. It was awesome. No more annoying GPT Chats, I dove into the wonderful world of Claude Code, learned vibe coding with Github, Vercel on Next.js. Wa

model-releasesr-chatgpt