I made a simple local voice input extension for pi (nemotron 3.5 0.6B ASR)

There are already plenty of different extensions for voice input, but all I found required having a second server running. I wanted something super simplistic: launching local STT server just for my pi coding terminal. NVIDIA Nemtron 3.5 ASR 0.6B was the obvious choice for me: super small, multi lingual and streaming support, runs on CPU more than fast enough for realtime. Originally I wanted to bundle parakeet.cpp, but I found NVIDIA has quietly published their own GGML based runtime: https://github.com/NVIDIA/NeMo-Speech.cpp Since it comes with an existing Q8 GGUF model on the official NVIDIA repo on huggingface which got uploaded literally yesterday: https://huggingface.co/nvidia/nemotron-3.5-asr-streaming-0.6b, I used this. The extension itself is intentionally super basic: launches STT server downloads ~700MB model from huggingface once keyboard shortcut opens popup and text appears while speaking text can be accepted or discarded, if accepted it gets put into the normal prompt input and can be edited settings allow for custom shortcut and language, default language is auto detection Originally I thought about adding a second LLM pass for cleanup, but this would have made it more complicated and I think coding agents are good enough on their own to make sense of bad transcriptions. Tested under Linux and Windows. Build for MacOS exists, but I cannot test it so if it’s not working I appreciate feedback. https://github.com/Danmoreng/talk-to-pi submitted by /u/Danmoreng [link] [comments]

Source: r/LocalLLaMA | 2026-08-07