Comparison of sEMG Encoding Accuracy Across Speech Modes Using Articulatory and Phoneme Features

arXiv:2604.18920v1 Announce Type: cross Abstract: We test whether Speech Articulatory Coding (SPARC) features can linearly predict surface electromyography (sEMG) envelopes across aloud, mimed, and subvocal speech in twenty-four subjects. Using elastic-net multivariate temporal response function (mTRF) with sentence-level cross-validation, SPARC yields higher prediction accuracy than phoneme one-hot representations on nearly all electrodes and in all speech modes. Aloud and mimed speech perform comparably, and subvocal speech remains above chance, indicating detectable articulatory activity. Variance partitioning shows a substantial unique contribution from SPARC and a minimal unique contribution from phoneme features. mTRF weight patterns reveal anatomically interpretable relationships between electrode sites and articulatory movements that remain consistent across modes. This study focuses on representation/encoding analysis (not end-to-end decoding) and supports SPARC as a robust and interpretable intermediate target for sEMG-based silent-speech modeling.

emg2speech: Synthesizing speech from electromyography using self-supervised speech models
iPhoneme: Brain-to-Text Communication for ALS Using ConformerXL Decoding
[[bd-tp-self-supervised-speech-models-discover-phonological-ve|[b]=[d]-[t]+[p]: Self-supervised Speech Models Discover Phonological Vector Arithmetic]]
Hard to Be Heard: Phoneme-Level ASR Analysis of Phonologically Complex, Low-Resource Endangered Languages

Source: arXiv cs.CL | 2026-04-22

Related