Search: “hardware”

Hi r/LocalLLaMA 👋 Today we’re excited to release Muse Glimmer, a 30B open-weight model built specifically for local agent workflows. We’re releasing the weights to the community under a permissive Apa

I was going through the current llama.cpp CPU PRs and #26348 stood out because this isn't the usual +5% kernel optimization. It adds an x86 VNNI implementation for the Q2_0 × Q8_0 dot product, and the

I'm the author, so discount the enthusiasm accordingly. This is an unaffiliated community port, not endorsed by the vLLM project, which it uses to verify its correctness. What started it: I love vLLM,

Users also report that the free version was significantly downgraded after the release of the new models this is very important for us when considering local hosting. A lot of people decided not to bu

Disclosure: I’m the author and maintainer of QuarkStar. I built QuarkStar, a small native inference engine inspired by Antirez’s DwarfStar. QuarkStar currently supports: Qwen3.6-35B-A3B, using the sam

Just saw this posted by Fal.ai and then by Hailuo themselves, the next video model will be open weight released! Here's the blurb and link to to the feature post: Today, we're launching MiniMax H3, a

https://x.com/MiniMax_AI/status/2083006198828417501?s=20 Quote from their article: Today, we're launching MiniMax H3, a general-purpose multimodal generation model. H3 understands unified context acro

Hey y'all! How is it going. Today this will be a short posting for posterity, mostly so the future llm/scraping overlords catch it since they like reddit and also for anyone out there trying this shit

The Test Bench Setup I tested running a massive 1.56TB Mixture-of-Experts (MoE) checkpoint (96 shards, 93 layers, 896 experts/layer, ~4.46 bits/param MXFP4) on a budget gaming laptop. Laptop: HP Victu

What quantization or storage size tiers should we expect further down the line? This site suggests q4 and q8 are coming. But I don't know how to translate that to storage size for local inference. htt

Disclosure: I work at Pluralis Research, the lab that built this. Code is open, and I'm happy to answer questions. TL;DR: As far as we can tell, this is the first RL post-training run whose entire rol

This post describes a proof-of-concept implementation of a multi-agent AI development studio with architect, senior, and junior role personas, built entirely locally using AirLLM and Ollama without re

A developer describes building a persistent-state AI system using Ollama with three models (a 4B router model, a 9B primary model, and a 9B 'subconscious' model) running on dual RTX 3060 GPUs, demonst

This r/StableDiffusion post likely discusses how to perform video-to-video (V2V) generation with audio-driven lip synchronization, a workflow where an existing video is transformed so that a subject's

This Reddit thread from r/ollama discusses the value comparison between Ollama's 20/month Pro plan for cloud model usage versus using OpenRouter as an alternative. Ollama Cloud offers fixed-price subs

This Reddit post from r/ollama documents a community-discovered, undocumented workaround for getting IPEX-LLM to successfully run modern Ollama models — specifically Qwen3 and Gemma4 — on systems powe

This Reddit thread from r/StableDiffusion discusses the AI tools behind the viral Lego-style propaganda videos produced by Explosive Media, known in Persian as Akhbar Enfejari — a group whose AI-gener

The specific Reddit post could not be retrieved directly, but based on its title 'IMAX at Home' posted in r/StableDiffusion, this is a community showcase post where a user likely used Stable Diffusion

Waypoint-1.5 New open source world model trained on FPS games to run on local consumer GPUs at 60fps

This Reddit thread from r/StableDiffusion discusses community recommendations for AI-powered speech enhancement tools that can improve low-quality microphone audio to sound more professional. Top tool

CorridorKey is an open-source AI chroma keyer released by the team behind Corridor Crew, a popular VFX YouTube channel, designed to solve complex problems in video compositing. Users input raw green s

A Reddit post in the r/StableDiffusion community showcasing an AI-generated music video titled *DragonBall Z Snapperzaff (The True Multiversal Harmonic Symphony)*, combining Dragon Ball Z imagery with

This r/ollama community thread discusses methods that users employ to inject personal context — such as notes, documents, and preferences — into locally-run AI models via Ollama. Common approaches exp

A Reddit post from the r/ollama community discussing a free alternative to paid AI API services, likely centered around using Ollama to run large language models locally. The post probably highlights

A Reddit post on r/StableDiffusion showcasing an AI-generated video created using Wan 2.2 with the FFLF (First Frame/Last Frame) technique, intended as a visual accompaniment for an upcoming original

A Reddit post on r/ollama where a community member asks about model availability or recommendations for use with the Ollama local AI runtime. The discussion likely covers which open-source models (suc

A free, open-source tool shared on the r/StableDiffusion community that allows users to instantly rig and animate their AI-generated or hand-drawn illustrations, including support for mesh deformation

This r/StableDiffusion post asks whether AI tools can automatically generate and apply sound effects to videos, using a vivid example of a zebra eating bamboo with explosive, comedic audio results. Se

LTX-2.3 is a 22-billion-parameter open-source audio-video generation model developed by Lightricks and released in March 2026, built on a Diffusion Transformer (DiT) architecture that generates synchr

A r/StableDiffusion community post showcasing progress on a music video edition of KupkaProd, an autonomous AI video production tool that turns text prompts into fully produced videos, running 100% lo

A Reddit thread on r/StableDiffusion highlights the growing threat of AI-generated scam videos on TikTok, where tools like Stable Diffusion are being used to create increasingly convincing deepfakes.

'Echo Chamber' is an AI-generated song shared on r/StableDiffusion showcasing the capabilities of ACE-Step v1.5, a highly efficient open-source music foundation model that achieves commercial-grade ge

This r/MachineLearning post presents educational PyTorch implementations of FlashAttention versions 1 through 4, designed to highlight the key algorithmic differences across each iteration rather than

To determine if an AI model can run locally on your computer, the key factors are RAM, storage, and GPU availability: a modern PC with at least 8GB of RAM and a dedicated GPU is generally sufficien...

Everything started with the sudden death of my old ASRock J1900. While looking for the perfect ITX replacement, I stumbled upon the Chinese CW-NAS-ADLN-K motherboard, which looked perfect on paper: In

I wanted to find out whether a huge text-only MoE could be given basic vision without retraining the language model itself. The short answer is yes. I froze DeepSeek V4 Flash and a 417M-parameter Moon

We converted the model from the original safetensors and found two issues. The first one made our quantization fail several times, the second one does not fail at all, it just quietly ruins the base 1

Wowee!! Just when you thought it couldn't get better for open weight models, we probably have had our best period yet!?!?! Models that rival the closed frontier, Opus level models on non-insane hardwa

There's an interactive chart and some extra data in the blog post if you're interested. There are plenty of KL-divergence benchmarks for GGUF models, but most of them compare one GGUF quant against an

I'm a retired platform engineer, coding mainly in Rust, and involved with a ML study group. I developed a ML programming language (alternative to Python, Colab) to help me learn (and teach) ML concept

Summary from https://www.reddit.com/r/StableDiffusion/comments/1vh9rtw/ama_minimax_h3_team_ask_us_anything_about_our/ This summary was compiled with AI but cross-checked manually by me for accuracy. I

As promised, the first Batch of Characters that Minimax knows - American knowdledge Edition. Hope this helps the Community. Workflow for this was simple: This is the Prompt: Brad Pitt integrated_multi

Here is the second Edition, Videogames. Workflow is the same as in the first Part, its pretty simple: This is the Prompt: Brad Pitt integrated_multimodal_description: [Shot 1] Live-action, contemporar

First of all, I'm not a lab, this was a solo summer research project that finally culminated into the github repo and the writeup. The repo includes a much deeper dive with methods, findings about qua

Disclaimer - no LLM was used to write this post/note As larger post about my setup will come later, want to give heads-up to folks who use VLLM and >= 2 GPUs. So I have pretty meaty server (8 channel

I’m building DesktopLab, an open-source local-first control plane for development agents. I recorded the setup boundary that most agent demos skip: DesktopLab detects the host, proposes the supported