Search: “hardware”

I'm the author, so discount the enthusiasm accordingly. This is an unaffiliated community port, not endorsed by the vLLM project, which it uses to verify its correctness. What started it: I love vLLM,

Users also report that the free version was significantly downgraded after the release of the new models this is very important for us when considering local hosting. A lot of people decided not to bu

Disclosure: I’m the author and maintainer of QuarkStar. I built QuarkStar, a small native inference engine inspired by Antirez’s DwarfStar. QuarkStar currently supports: Qwen3.6-35B-A3B, using the sam

Just saw this posted by Fal.ai and then by Hailuo themselves, the next video model will be open weight released! Here's the blurb and link to to the feature post: Today, we're launching MiniMax H3, a

https://x.com/MiniMax_AI/status/2083006198828417501?s=20 Quote from their article: Today, we're launching MiniMax H3, a general-purpose multimodal generation model. H3 understands unified context acro

Hey y'all! How is it going. Today this will be a short posting for posterity, mostly so the future llm/scraping overlords catch it since they like reddit and also for anyone out there trying this shit

The Test Bench Setup I tested running a massive 1.56TB Mixture-of-Experts (MoE) checkpoint (96 shards, 93 layers, 896 experts/layer, ~4.46 bits/param MXFP4) on a budget gaming laptop. Laptop: HP Victu

Disclosure: I work at Pluralis Research, the lab that built this. Code is open, and I'm happy to answer questions. TL;DR: As far as we can tell, this is the first RL post-training run whose entire rol

This post describes a proof-of-concept implementation of a multi-agent AI development studio with architect, senior, and junior role personas, built entirely locally using AirLLM and Ollama without re

A developer describes building a persistent-state AI system using Ollama with three models (a 4B router model, a 9B primary model, and a 9B 'subconscious' model) running on dual RTX 3060 GPUs, demonst

This r/StableDiffusion post likely discusses how to perform video-to-video (V2V) generation with audio-driven lip synchronization, a workflow where an existing video is transformed so that a subject's

This Reddit thread from r/ollama discusses the value comparison between Ollama's 20/month Pro plan for cloud model usage versus using OpenRouter as an alternative. Ollama Cloud offers fixed-price subs

This Reddit post from r/ollama documents a community-discovered, undocumented workaround for getting IPEX-LLM to successfully run modern Ollama models — specifically Qwen3 and Gemma4 — on systems powe

This Reddit thread from r/StableDiffusion discusses the AI tools behind the viral Lego-style propaganda videos produced by Explosive Media, known in Persian as Akhbar Enfejari — a group whose AI-gener

The specific Reddit post could not be retrieved directly, but based on its title 'IMAX at Home' posted in r/StableDiffusion, this is a community showcase post where a user likely used Stable Diffusion

Waypoint-1.5 New open source world model trained on FPS games to run on local consumer GPUs at 60fps

This Reddit thread from r/StableDiffusion discusses community recommendations for AI-powered speech enhancement tools that can improve low-quality microphone audio to sound more professional. Top tool

CorridorKey is an open-source AI chroma keyer released by the team behind Corridor Crew, a popular VFX YouTube channel, designed to solve complex problems in video compositing. Users input raw green s

A Reddit post in the r/StableDiffusion community showcasing an AI-generated music video titled *DragonBall Z Snapperzaff (The True Multiversal Harmonic Symphony)*, combining Dragon Ball Z imagery with

This r/ollama community thread discusses methods that users employ to inject personal context — such as notes, documents, and preferences — into locally-run AI models via Ollama. Common approaches exp

A Reddit post from the r/ollama community discussing a free alternative to paid AI API services, likely centered around using Ollama to run large language models locally. The post probably highlights

A Reddit post on r/StableDiffusion showcasing an AI-generated video created using Wan 2.2 with the FFLF (First Frame/Last Frame) technique, intended as a visual accompaniment for an upcoming original

A Reddit post on r/ollama where a community member asks about model availability or recommendations for use with the Ollama local AI runtime. The discussion likely covers which open-source models (suc

A free, open-source tool shared on the r/StableDiffusion community that allows users to instantly rig and animate their AI-generated or hand-drawn illustrations, including support for mesh deformation

This r/StableDiffusion post asks whether AI tools can automatically generate and apply sound effects to videos, using a vivid example of a zebra eating bamboo with explosive, comedic audio results. Se

LTX-2.3 is a 22-billion-parameter open-source audio-video generation model developed by Lightricks and released in March 2026, built on a Diffusion Transformer (DiT) architecture that generates synchr

A r/StableDiffusion community post showcasing progress on a music video edition of KupkaProd, an autonomous AI video production tool that turns text prompts into fully produced videos, running 100% lo

A Reddit thread on r/StableDiffusion highlights the growing threat of AI-generated scam videos on TikTok, where tools like Stable Diffusion are being used to create increasingly convincing deepfakes.

'Echo Chamber' is an AI-generated song shared on r/StableDiffusion showcasing the capabilities of ACE-Step v1.5, a highly efficient open-source music foundation model that achieves commercial-grade ge

This r/MachineLearning post presents educational PyTorch implementations of FlashAttention versions 1 through 4, designed to highlight the key algorithmic differences across each iteration rather than

To determine if an AI model can run locally on your computer, the key factors are RAM, storage, and GPU availability: a modern PC with at least 8GB of RAM and a dedicated GPU is generally sufficien...

I built BitRun because I wanted to run 1-bit ternary LLMs on ordinary laptops without melting my battery, spinning up a dedicated GPU, or wrestling with complex build environments. Right now, BitRun g

pixel-curator — curation tooling for similarity training (identity, subject, and style models) Repo: https://github.com/snoozey-mf-bnui/pixel-curator What it is pixel-curator is a local-first CLI that

So I wanted to try the horsey challenge myself on the latest engine i been testing which is a strata fork by sergqwer. https://github.com/sergqwer/strata-nvfp4. I seen a post earlier and seen i believ

tl;dr: running Qwen3.8FN Q4 locally is cheaper for me than every cloud model except Luna and the newer Haiku at mid-peak and peak electricity pricing where I live, and becomes the absolute cheapest mo

I am an independent researcher. Due to budget constraints, I shifted my 21B MoE pre-training—which I had originally planned to run on 64 H100s—to a single NVIDIA GH200 ($2.29 per hour), and I have com

Quick context: LocalLightChat (LLC) is a chat frontend for local LLMs. Download it, run it, that's it. No installation (unless you want to), no dependencies, and it runs on pretty much anything, inclu

EXL3-QLoRA I've built this over the last few months and I think it's stable enough to share now. A fork of ExLlamaV3, this is a native ExLlamaV3 training implementation with plain PyTorch, without tra

For the past few weeks I've been trying out converting existing dense models to sparse Mixture-of-Experts models, with no pretraining from scratch. The Idea If you can turn a dense model into an MoE t

There is a lot of discussion which quant to use. Especially a lot of post how much speed you gain with FP4, but not much about quality. So i tested some of the models that I use on my R9700. Models: Q

DISCLAIMER: the post and the model card was made with the assist of AI. Hiya, I’m releasing Recursive BitNet N-Gram 102M, a small experiment combining ternary weights, shared transformer layers, and h

Hey r/LocalLLaMA! Maintainer here. Some of you might remember OpenMed from our 1.8 post a few months back. Quick recap: it's an open-source (Apache-2.0) medical AI toolkit with one rule we never break

I stumbled across this as I was currently having glm5.3 flash run only around 10tok/s basically unusable. With Maya i am running 30 tok/s now. GLM5.3 feels even with this low quant like a much more en

This is a follow-up to my post from yesterday (https://www.reddit.com/r/LocalLLaMA/comments/1x2erdj/qwen3827b_on_a_single_3090_140_toks_on_code_with/) detailing the CUDA megakernel. Thank you all for

Running HauhauCS/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive Q4_K_M with llama.cpp at ~600 tok/s prefill and 23 tok/s decode, 131k context window, Q8 KV cache - on an RTX 2060 6GB + 32GB DDR4 RAM.

Strata vs Infernix on the same model, RTX 5090 — A/B at 262k and 512k context Hi folks, another inference engine post for your feed. I was blown away by Strata, but saw someone else post about Inferni