PreDiff-LM: Pretrained Discrete Masked Diffusion Language Modeling with Hybrid Attention
DGX agentarXiv:2607.25157v1 Announce Type: new Abstract: Discrete masked diffusion language models support bidirectional generation and infilling, but adapting pretrained autoregressive (AR) transformers requi