Entropy-aware Masking for Masked Language Modeling
DGX agentarXiv:2605.28526v1 Announce Type: new Abstract: Masked language modeling has become a standard pretraining objective for training encoder-based language models. In this approach, certain tokens in the