Safety
When Robots Mishear Us: Mapping the Safety Risks of Voice-Controlled Embodied AI
arXiv:2608.28518v1 Announce Type: cross Abstract: We investigate whether automatic speech recognition (ASR) errors in user input can lead to unsafe outputs from Embodied AI (EAI) models. We find that
arXiv:2608.28518v1 Announce Type: cross Abstract: We investigate whether automatic speech recognition (ASR) errors in user input can lead to unsafe outputs from Embodied AI (EAI) models. We find that ASR errors can lead to harmful instructions being accepted and executed by EAI models, thereby reducing safety. We simulate ASR errors and combine them with existing safety benchmarks (SafeAgentBench and POEX) to evaluate how different errors affect embodied AI safety. We find that some of them preserve semantic structure but increase harmful ambiguity, while others weaken the model refusal behaviour and allow unsafe plans to be generated and executed. We show that in some cases automatic correction of ASR errors can reduce the risk, but this is not always effective. Overall, we show that ASR errors lead to significant safety risks for embodied AI.
Related
- Decolonizing Linguistic Policies in Automated Speech Recognition: A Framework for Cross-Culturally Competent Speech AI
- Enhancing Multilingual LLM-based ASR with Mixture of Experts and Dynamic Downsampling
- SCRIBE: Diagnostic Evaluation and Rich Transcription Models for Indic ASR
- Generation-Step-Aware Framework for Cross-Modal Representation and Control in Multilingual Speech-Text Models
Source: arXiv cs.CL | 2026-08-31