Model Releases

New wave of miniboss models you can run on dual DGX Spark

Two DGX Spark and a Connect-X7 cable give you about 250GB of usable memory for 7000 8000 USD. This allows using some interesting models at 4-bit. For what seemed like an eternity, the only serious mod

DGX agentreddit
model-releasesr-localllama

Two DGX Spark and a Connect-X7 cable give you about 250GB of usable memory for 7000 8000 USD. This allows using some interesting models at 4-bit. For what seemed like an eternity, the only serious models in that size were GLM 4.5/4.6/4.7 (194GB), Qwen 3.5 397B (210GB), and older MiniMax. Then 3 months ago we got MiniMax M2.7 (131GB), Deepseek V4 Flash (160GB) and Xiaomi MiMo 2.5 (181GB). Shortly later we got StepFun 3.7 Flash (129GB), and now we just got Tencent's Hy3 (182GB). I know this size is inaccessible to a lot of people on here, but 7k 8k seems reasonable acceptable to me to be able to run models of this power level. Have you been using them? Which is your favorite? [P.S. please don't read this post and run off to spend 7k without first spending 7 trying these models on OpenRouter first.] submitted by /u/dtdisapointingresult [link] [comments]

Source: r/LocalLLaMA | 2026-07-15

Loading related sources…