Data-Efficient Autoregressive-to-Diffusion Language Models via On-Policy Distillation
DGX agentarXiv:2606.06712v1 Announce Type: cross Abstract: We study the transformation of autoregressive models (ARLMs) into diffusion language models (DLMs). Rather than pretraining from scratch, prior work r