Local Ai
Got Microsoft's VibeVoice TTS running locally with OpenAI-compatible API — here's my setup
Microsoft's VibeVoice-Realtime-0.5B is an open-source TTS model that generates natural-sounding speech with voice cloning capabilities . A community-built wrapper project (`marhensa/vibevoice-real...
Microsoft's VibeVoice-Realtime-0.5B is an open-source TTS model that generates natural-sounding speech with voice cloning capabilities . A community-built wrapper project (marhensa/vibevoice-realtime-openai-api) enables running it locally as an OpenAI API-compatible text-to-speech server, with Docker or Python venv support, multiple voices with OpenAI aliases, and CUDA optimization . The setup achieves roughly 0.5x real-time factor on an RTX 3060, requires only ~2GB of VRAM, and supports 7 voices with OpenAI name aliases such as "alloy" and "nova" ; it is also natively supported via LocalAI's VibeVoice backend, which exposes a TTS API compatible with both the OpenAI TTS API and the ElevenLabs API .
Related
- OmniVoice: multilingual local TTS with 600+ languages, voice cloning, and an OpenAI-compatible server
- kugel-2 model (VibeVoice finetune) repo is gone. Does anyone know why?
- I built AmicoScript: A local-first Whisper UI with Speaker Diarization and Ollama integration for summaries.
- MinusPod: Fully Self-Hostable Automatic Podcast Ad Removal.
Source: local-ai