I made a Forge Neo extension for MiniMax H3: text or picture to video with sound, reference pictures, runs on 16 GB

I've been working on an extension that runs MiniMax H3 inside Forge Neo. H3 makes the picture and the sound together, in one pass: footsteps, rain, engines, music and dialogue in pretty much any language, lip-synced to the speaker. The video above came out of it exactly as Forge saved it, on a 16 GB card with 32 GB of system RAM. It works in the normal txt2img and img2img tabs, with the same checkpoint list, VAE / Text Encoder selector and Generate button. You get an MP4 with stereo sound in the usual result area. No separate program, no new tab, no extra Python packages, and no Forge Neo file is changed. What works Text to video with sound, up to 15 seconds at 24 fps First and last frame: the img2img picture becomes the first frame, a picture in Forge's ImageStitch Integrated becomes the last, or both Reference pictures (Ref2VA): up to 9 pictures of people, places and objects that the clip keeps Smaller files: W4A8, GGUF and an INT4 text encoder, so it fits 24 GB and 16 GB cards LoRAs (turbo LoRA for 8-step drafts), FastH3 and community fine-tunes Forge's own tools: Never OOM, Sparse Attention (adapted to H3, up to a quarter faster on long clips), ck attention, live preview Be realistic about the hardware. Tested on an A40 (48 GB), an RTX 4090 (24 GB) and an RTX 2000 Ada (16 GB). On the A40 a 5-second 960×544 clip takes about 3 minutes at 20 steps, about 1 minute with the turbo LoRA. The wizard above (8 seconds) took 27 minutes on the 16 GB card, which is a slow one. System RAM matters as much as the GPU: about 32 GB with the smaller files, about 50 GB with the INT8 set. Cards under 16 GB are untested. The wiki has everything: every example with its prompt, settings and time, a guide to MiniMax's prompt format, comparisons of the file formats and speed options, a Bloopers page with the clips that went wrong and how to avoid them, and an All Generations page with all 168 clips made while testing it, good and bad. Repo: https://github.com/eduardoabreu81/minimax-h3-forge-neo Wiki: https://github.com/eduardoabreu81/minimax-h3-forge-neo/wiki Bloopers: https://github.com/eduardoabreu81/minimax-h3-forge-neo/wiki/Bloopers It needs an up-to-date Forge Neo (the neo branch from 3 October 2026 or later). Install from URL in the Extensions tab and restart. It's a work in progress, so feedback and bug reports are welcome. Next up: video and audio clips as references, then pose, depth and edge control. submitted by /u/digitalhunters0 [link] [comments]

Source: r/StableDiffusion | 2026-10-06