Industry

Train with autoregression & convert weights to diffusion for inference.

Train with autoregression & convert weights to diffusion for inference. Most researchers agree that autoregression is best when memory bandwidth is cheap and diffusion is best when FLOPS are cheap. Th

DGX agentx-post
industryemad-mostaque--x

Train with autoregression & convert weights to diffusion for inference. Most researchers agree that autoregression is best when memory bandwidth is cheap and diffusion is best when FLOPS are cheap. They also admit the future of compute is all FLOPS because memory scaling is hard and scaling FLOPS is easy. So why not go all in on diffusion????

Source: Emad Mostaque (X) | 2026-05-27

Loading related sources…