I used Hermes Agent + ComfyUI MCP + MiniMax prompts to turn a music track into a short music video

The initial reason for this was the Comfy H3 Sync & Sound Community Challenge: Comfy H3 Sync Sound Community Challenge! - by Allyson Toy I made a short rap track in Suno, then used Hermes Agent to build a short music video around it. For the image base, I used this Anima Simple T2I workflow, including upscale/detailer and ControlNet options: 【Anima】Simple T2I Workflow with Upscale, Detailers and ControlNet - v3.2 | Anima Workflows | Civitai For the MiniMax video stage, I used foxdit’s MiniMax SEED HUNTER ComfyUI workflow from Reddit My process: I made the song and defined the lyrics, beat, and attitude in Suno. I gave Hermes this link: Comfy MCP - Drive ComfyUI from any AI agent — and let it install the ComfyUI MCP for me. Hermes connected to my local ComfyUI and could check the setup, find/load workflows, fill prompts and settings, queue renders, monitor jobs, and collect outputs. Using the Anima T2I workflow, I created a consistent set of music-video keyframes locally, then ran them through the upscale/detailer pipeline. I selected the best images and gave them to Hermes’ MiniMax H3 prompt skill. (I just gave hermes a standard Minimax prompt guide an build a prompt skill out of it) It turned rough shot ideas into structured video prompts: what each reference controls, how identity and wardrobe stay consistent, where cuts happen, what the camera does, and how lip-sync/body movement should work. I used those prompts with the MiniMax H3 workflow to generate short performance clips driven by the Suno track for the challenge. I use Hermes with my ChatGPT Plus subscription, plus DeepSeek V4 Flash for the cheaper iterations. That made it practical to keep refining prompts and shots without treating every adjustment like a premium final render. The pipeline was: Suno song → ComfyUI keyframes → upscaling/detailing → MiniMax prompts → short music-video clips Hermes was the bridge between the tools. submitted by /u/Ok-Wolverine-5020 [link] [comments]

Source: r/StableDiffusion | 2026-08-28

Related