Local Ai
What is a good tool+model for near-realtime voice conversation?
Looking for tools to build/run an engine to do STT-LLM-TTS basically. I know how to run all of them separately, and if need be I can build one myself, but I was curious if there is already an open sou
Looking for tools to build/run an engine to do STT-LLM-TTS basically. I know how to run all of them separately, and if need be I can build one myself, but I was curious if there is already an open source tool out there that can do this. I know that some UIs like Open WebUI can do this but I find it to be not fluid. I don't know about SillyTavern though, it might already have it. This is just for the funsies so it doesn't have to be perfect. I saw this model https://huggingface.co/LessThanThreeAI/Qwen3.8-27B-Humanlike-Chat-GGUF and I bet I will have a LOT of fun if I can just turn this into a turn based or fluid voice conversation engine. submitted by /u/dodiyeztr [link] [comments]
Related
- Sopro V2: SOTA-level voice cloning TTS at 120M params, open-source and CPU-friendly
- Tossed distorted audio samples to an open-weight voice model; it did fairly well.
- Best open-source harnesses for combining cloud and local AI model orchestration?
Source: r/LocalLLaMA | 2026-09-11