Hybrid Continual Learning for Low-Resource Australian Aboriginal Language Identification

arXiv:2607.11946v1 Announce Type: new Abstract: Language identification is an important step toward integrating endangered Australian Aboriginal languages (AALs) into speech technologies supporting language revitalisation and digital inclusion. However, extreme data scarcity limits model performance. Transfer learning from high-resource languages shows promise but often suffers from catastrophic forgetting when adapting to new languages. Continual learning (CL) can mitigate this issue, though it remains challenging with very limited data. To address this, we propose two hybrid continual learning methods: Replay Augmented Elastic Weight Consolidation and Constraint Guided Knowledge Distillation to adapt pretrained speech models for AAL identification while preserving previously learned knowledge. Experiments on Warlpiri, Dalabon and Dharawal show that the proposed methods outperform fine-tuning and existing CL baselines, improving adaptation to multiple AALs while maintaining performance on previously learnt high-resource languages.

Related

• Jointly Improving Dialect Identification and ASR in Indian Languages using Multimodal Feature Fusion
• From Sinhala to Dhivehi: Cross-Lingual Transfer Learning for Low-Resource Speech Recognition
• Hard to Be Heard: Phoneme-Level ASR Analysis of Phonologically Complex, Low-Resource Endangered Languages
• An Empirical Study of Many-Shot In-Context Learning for Machine Translation of Low-Resource Languages

Source: arXiv cs.CL | 2026-07-15