Local Ai
I made a service for hosting multiple audio diffusion models on a single GPU
Hi Stable Diffusion People! I recently got into local audio generation but I didn't want to use ComfyUI for it (although I absolutely love it for image generation!) but I started to run out of room on
Hi Stable Diffusion People! I recently got into local audio generation but I didn't want to use ComfyUI for it (although I absolutely love it for image generation!) but I started to run out of room on my GPU for all of the different audio generators. So made a service which manages all of the different audio generators and allows hot swapping between them. The way it works is like this: I have made a custom fork of the official repos for these service with a simple API I added a RAM offload for each of them, so that the models can be offloaded to system RAM I made an orchestrator which parks them and switches between them. If they can't be offloaded (or configured not to) then they just stop I added a test page with a UI for each of the services This is a free open source project with a permissive licence: https://github.com/stevelittlefish/AudioSlopServer I've included the following services: YuE 2 ACE-step 1.5 xl Stable Audio 3 DEMUCS (stem separation) Forced Aligner (for aligning lyrics in karaoke systems) I have plans to add in TTS and STT so you can generate a whole AI radio station. Having access to all of this opens up many cool things - I have made apps with custom workflows that do things like: Generate a song with ACE-step Separate out the vocals and backing track Run the backing track through Stable Audio 3 Mix the original vocal back in This is a great way to fix things like the guitars rendered by ACE-step with that weird sound it makes. Internally this uses docker for orchestration - each of the sub services are their own docker images. Using forks of the original repos makes it easy to merge in changes from the official repositories to add fixes etc. I hope this is of use to someone. I had a lot of fun messing with it. Just having the simple test UI for each service is pretty handy! submitted by /u/SteveLittleFish [link] [comments]
Related
Source: r/StableDiffusion | 2026-09-20