Model Releases
Does Financial Speech Need Continual Learning Regularization? A Study of EWC and mini-KFAC on Earnings Call ASR
arXiv:2610.13432v1 Announce Type: cross Abstract: Earnings call transcription presents a realistic continual learning scenario where Automatic Speech Recognition (ASR) systems are updated with new rec
arXiv:2610.13432v1 Announce Type: cross Abstract: Earnings call transcription presents a realistic continual learning scenario where Automatic Speech Recognition (ASR) systems are updated with new recordings but risk catastrophic forgetting of previously learned financial speech patterns. Adapting Whisper-small from a general-domain speech corpus to the Earnings22 benchmark reveals the opposite: all evaluated methods exhibit improvement on held-out financial speech from the same domain during adaptation rather than forgetting. This task complementarity makes regularization counterproductive. Nevertheless, when regularization is warranted, a layer-wise mini-Kronecker-Factored Approximate Curvature (mini-KFAC) approximation seems to achieve lower word error rates (WERs) and more stable optimization than standard diagonal Elastic Weight Consolidation (EWC). The results suggest that task complementarity should be assessed before applying continual learning constraints, and prefer mini-KFAC EWC over diagonal EWC when needed.
Related
- Modality-Inconsistent Continual Learning of Multimodal Large Language Models
- Navigating the Reality Gap: On-Device Continual Adaptation of ASR for Clinical Telephony
- Sequential Adapter Stacking for Cross-Lingual Low-Resource ASR
- Pseudo2Real: Task Arithmetic for Pseudo-Label Correction in Automatic Speech Recognition
Source: arXiv cs.CL | 2026-10-12