Diffusion for generating/editing ASTs? [D]

Recent advances in diffusion-based language models enable controllable sequence generation, but applying them to structured code remains challenging, prompting exploration of syntax-aware diffusion frameworks that incorporate Abstract Syntax Tree (AST) priors into the denoising process. Such approaches selectively corrupt syntactically meaningful code spans derived from AST subtrees, enabling models to reconstruct programs while respecting grammatical boundaries and capturing long-range dependencies.

Source: r/MachineLearning | 2026-05-07