Machine Learning, Artificial Intelligence, Technology, Programming, Data Science.
baseline, (ii) a diffusion baseline, and (iii) AR2Diff models that adapt the pretrained AR baseline via diffusion training for N steps before fine-tuning using diffusion, with N ∈ {0, 10K, 100K}. Microsoft’s GENIE, introduced in the paper “Text generation with diffusion language models: a