Machine Learning, Artificial Intelligence, Technology, Programming, Data Science.
it shows promise in code synthesis and question answering, even outperforming autoregressive models. These findings suggest text diffusion, which can be faster for long text, deserves further exploration. Performance of various models across three tasks and three sizes, comparing: (i) an AR