High-Fidelity Image Compression with Score-based Generative Models
Despite the tremendous success of diffusion generative models in
text-to-image generation, replicating this success in the domain of image
compression has proven difficult. In this paper, we demonstrate that diffusion
can significantly improve perceptual quality at a given bit-rate, outperforming
state-of-the-art approaches PO-ELIC and HiFiC as measured by FID score. This is
achieved using a simple but theoretically motivated two-stage approach
combining an autoencoder targeting MSE followed by a further score-based
decoder. However, as we will show, implementation details matter and the
optimal design decisions can differ greatly from typical text-to-image models.
6475745dd815855e4ef9a16e
Emiel Hoogeboom
extracted_confirmed
2024-10-28T19:59:48.563Z
671feaa3e269c38584cb065f
/avatars/d7bc35ab98b208ef1d009aa9b629682a.svg
Emiel Hoogeboom
user
Emiel2
6475745dd815855e4ef9a16f
Eirikur Agustsson
6475745dd815855e4ef9a170
Fabian Mentzer
6475745dd815855e4ef9a171
Luca Versari
6475745dd815855e4ef9a172
George Toderici
6475745dd815855e4ef9a173
Lucas Theis
High-Fidelity Image Compression with Score-based Generative Models
Despite the tremendous success of diffusion generative models in
text-to-image generation, replicating this success in the domain of image
compression has proven difficult. In this paper, we demonstrate that diffusion
can significantly improve perceptual quality at a given bit-rate, outperforming
state-of-the-art approaches PO-ELIC and HiFiC as measured by FID score. This is
achieved using a simple but theoretically motivated two-stage approach
combining an autoencoder targeting MSE followed by a further score-based
decoder. However, as we will show, implementation details matter and the
optimal design decisions can differ greatly from typical text-to-image models.
Diffusion models enhance image compression perceptual quality by integrating an MSE-targeting autoencoder with a score-based decoder, surpassing current methods.
diffusion generative models text-to-image generation image compression perceptual quality bit-rate FID score autoencoder MSE score-based decoder