Rolling Diffusion Models
Diffusion models have recently been increasingly applied to temporal data
such as video, fluid mechanics simulations, or climate data. These methods
generally treat subsequent frames equally regarding the amount of noise in the
diffusion process. This paper explores Rolling Diffusion: a new approach that
uses a sliding window denoising process. It ensures that the diffusion process
progressively corrupts through time by assigning more noise to frames that
appear later in a sequence, reflecting greater uncertainty about the future as
the generation process unfolds. Empirically, we show that when the temporal
dynamics are complex, Rolling Diffusion is superior to standard diffusion. In
particular, this result is demonstrated in a video prediction task using the
Kinetics-600 video dataset and in a chaotic fluid dynamics forecasting
experiment.
65ced598dbabc794a126c77b
David Ruhe
admin_assigned
2024-02-16T14:26:47.815Z
64c2b612831aa8a12856a0a7
/avatars/40aa035450f665571dd0650eca2c4ea6.svg
David Ruhe
user
druhe
65ced598dbabc794a126c77c
Jonathan Heek
65ced598dbabc794a126c77d
Tim Salimans
65ced598dbabc794a126c77e
Emiel Hoogeboom
Rolling Diffusion Models
Diffusion models have recently been increasingly applied to temporal data
such as video, fluid mechanics simulations, or climate data. These methods
generally treat subsequent frames equally regarding the amount of noise in the
diffusion process. This paper explores Rolling Diffusion: a new approach that
uses a sliding window denoising process. It ensures that the diffusion process
progressively corrupts through time by assigning more noise to frames that
appear later in a sequence, reflecting greater uncertainty about the future as
the generation process unfolds. Empirically, we show that when the temporal
dynamics are complex, Rolling Diffusion is superior to standard diffusion. In
particular, this result is demonstrated in a video prediction task using the
Kinetics-600 video dataset and in a chaotic fluid dynamics forecasting
experiment.
Rolling Diffusion enhances temporal data generation by progressively corrupting frames with increasing noise, outperforming standard diffusion in complex tasks like video prediction and fluid dynamics forecasting.
diffusion models Rolling Diffusion sliding window denoising temporal data diffusion process Kinetics-600 video dataset chaotic fluid dynamics forecasting