Training Intelligent Voice Assistant Wakeup with Controllable Synthetic Conversations

arXiv:2609.27037v1 Announce Type: new Abstract: Wake word detection is a critical component of virtual assistants, serving as the gateway to seamless user interactions. This paper introduces a novel wake-up system that extends traditional direct keyword detection with contextual trigger detection. After an initial wake word activation, the system uses reasoning to distinguish between user commands and unrelated speech, ensuring efficient and context-aware engagement. We present a data generation architecture that produces a 62.3-hour corpus of controllable multi-speaker conversations containing direct invocations, contextual follow-ups, and non-addressed speech. Experimental results demonstrate the effectiveness of the proposed approach across diverse synthetic conversational scenarios. We release the code, dataset and trained models to promote reproducibility and further advancements in intelligent assistant technologies.

Few-Shot Out of Domain Intent Detection with Covariance Corrected Mahalanobis Distance
Generative AI-Based Virtual Assistant using Retrieval-Augmented Generation: An evaluation study for bachelor projects
Toward Metaphor-Fluid Conversation Design for Voice User Interfaces
WASIL: In-the-Wild Arabic Spoken Interactions with LLMs

Source: arXiv cs.AI | 2026-09-24

Related