Research
Quantifying Cross-Lingual Transfer in Paralinguistic Speech Tasks
arXiv:2603.08231v2 Announce Type: replace-cross Abstract: Paralinguistic speech tasks are often considered relatively language-agnostic, as they rely on extralinguistic acoustic cues rather than lexic
arXiv:2603.08231v2 Announce Type: replace-cross Abstract: Paralinguistic speech tasks are often considered relatively language-agnostic, as they rely on extralinguistic acoustic cues rather than lexical content. However, prior studies report performance degradation under cross-lingual conditions, indicating non-negligible language dependence. Still, these studies typically focus on isolated language pairs or task-specific settings, limiting comparability and preventing a systematic assessment of task-level language dependence. We introduce the Cross-Lingual Transfer Matrix (CLTM), a systematic method to quantify cross-lingual interactions between pairs of languages within a given task. We apply the CLTM to two paralinguistic tasks, gender identification and speaker verification, using a multilingual HuBERT-based encoder, to analyze how donor-language data affects target-language performance during fine-tuning. Our results reveal distinct transfer patterns across tasks and languages, reflecting systematic, language-dependent effects.
Related
- From Sinhala to Dhivehi: Cross-Lingual Transfer Learning for Low-Resource Speech Recognition
- Language Orthogonalization for Zero-Shot Cross-Lingual Audio Deepfake Detection
- Cross-lingual Matryoshka Representation Learning across Speech and Text
- DonorRank: Donor Language Selection for Low-Resource Cross-Lingual Speech Recognition
Source: arXiv cs.CL | 2026-10-07