Constrained Diffusion Implicit Models
This paper describes an efficient algorithm for solving noisy linear inverse
problems using pretrained diffusion models. Extending the paradigm of denoising
diffusion implicit models (DDIM), we propose constrained diffusion implicit
models (CDIM) that modify the diffusion updates to enforce a constraint upon
the final output. For noiseless inverse problems, CDIM exactly satisfies the
constraints; in the noisy case, we generalize CDIM to satisfy an exact
constraint on the residual distribution of the noise. Experiments across a
variety of tasks and metrics show strong performance of CDIM, with analogous
inference acceleration to unconstrained DDIM: 10 to 50 times faster than
previous conditional diffusion methods. We demonstrate the versatility of our
approach on many problems including super-resolution, denoising, inpainting,
deblurring, and 3D point cloud reconstruction.
6729667d02305fd23643b8ca
Vivek Jayaram
claimed_verified
2024-11-05T07:58:23.587Z
660e1fef1a20b667fca9adb3
/avatars/7731122e279df67fbd95cc2b9dc369d3.svg
Vivek Jayaram
user
vivjay30
6729667d02305fd23643b8cb
Ira Kemelmacher-Shlizerman
6729667d02305fd23643b8cc
Steven M. Seitz
6729667d02305fd23643b8cd
John Thickstun
Constrained Diffusion Implicit Models
This paper describes an efficient algorithm for solving noisy linear inverse
problems using pretrained diffusion models. Extending the paradigm of denoising
diffusion implicit models (DDIM), we propose constrained diffusion implicit
models (CDIM) that modify the diffusion updates to enforce a constraint upon
the final output. For noiseless inverse problems, CDIM exactly satisfies the
constraints; in the noisy case, we generalize CDIM to satisfy an exact
constraint on the residual distribution of the noise. Experiments across a
variety of tasks and metrics show strong performance of CDIM, with analogous
inference acceleration to unconstrained DDIM: 10 to 50 times faster than
previous conditional diffusion methods. We demonstrate the versatility of our
approach on many problems including super-resolution, denoising, inpainting,
deblurring, and 3D point cloud reconstruction.
CDIM modifies DDIM to enforce constraints, achieving strong performance and fast inference times across various inverse problems.
denoising diffusion implicit models DDIM constrained diffusion implicit models CDIM inference acceleration super-resolution denoising inpainting deblurring 3D point cloud reconstruction residual distribution