JVID: Joint Video-Image Diffusion for Visual-Quality and Temporal-Consistency in Video Generation
<|reference_start|>JVID: Joint Video-Image Diffusion for Visual-Quality and Temporal-Consistency in Video Generation: We introduce the Joint Video-Image Diffusion model (JVID), a novel approach to generating high-quality and temporally coherent videos. We achieve this by integrating two diffusion models: a Latent Image Diffusion Model (LIDM) trained on images and a Latent Video Diffusion Model (LVDM) trained on video data. Our method combines these models in the reverse diffusion process, where the LIDM enhances image quality and the LVDM ensures temporal consistency. This unique combination allows us to effectively handle the complex spatio-temporal dynamics in video generation. Our results demonstrate quantitative and qualitative improvements in producing realistic and coherent videos.<|reference_end|>
@article{reynaud2024jvid:,
    title={JVID: Joint Video-Image Diffusion for Visual-Quality and
  Temporal-Consistency in Video Generation},
    author={Hadrien Reynaud and Matthew Baugh and Mischa Dombrowski and Sarah
  Cechnicka and Qingjie Meng and Bernhard Kainz},
    journal={arXiv preprint arXiv:2409.14149},
    year={2024},
    archivePrefix={arXiv},
    eprint={2409.14149},
    primaryClass={cs.CV}
}