Safety
Streaming Translation and Transcription Through Speech-to-Text Causal Alignment
arXiv:2603.11578v2 Announce Type: replace Abstract: Simultaneous machine translation (SiMT) has traditionally relied on offline machine translation models coupled with human-engineered heuristics or l
arXiv:2603.11578v2 Announce Type: replace Abstract: Simultaneous machine translation (SiMT) has traditionally relied on offline machine translation models coupled with human-engineered heuristics or learned policies. We propose Hikari, a policy-free, end-to-end model for simultaneous speech-to-text translation and streaming transcription. We also introduce Decoder Time Dilation, a mechanism that counteracts the overrepresentation of WAIT tokens in training. We present a supervised fine-tuning strategy that trains the model to recover from delays, significantly improving the quality-latency trade-off. Despite its modest size, Hikari delivers competitive translation quality at consistently low latency, comparing favorably with published IWSLT 2026 submissions up to 38x larger and with proprietary API systems across en-ja, en-de, and en-ru. We release our model weights and code to facilitate further research.
Related
- A Pocket Offline Model for Simultaneous Speech Translation as CUNI Submission to IWSLT 2026
- Voice, Bias, and Coreference: An Interpretability Study of Gender in Speech Translation
- Towards Fine-Grained Code-Switch Speech Translation with Semantic Space Alignment
- Hierarchical Policy Optimization for Simultaneous Translation of Unbounded Speech
Source: arXiv cs.CL | 2026-09-11