Matten: Video Generation with Mamba-Attention
<|reference_start|>Matten: Video Generation with Mamba-Attention: In this paper, we introduce Matten, a cutting-edge latent diffusion model with Mamba-Attention architecture for video generation. With minimal computational cost, Matten employs spatial-temporal attention for local video content modeling and bidirectional Mamba for global video content modeling. Our comprehensive experimental evaluation demonstrates that Matten has competitive performance with the current Transformer-based and GAN-based models in benchmark performance, achieving superior FVD scores and efficiency. Additionally, we observe a direct positive correlation between the complexity of our designed model and the improvement in video quality, indicating the excellent scalability of Matten.<|reference_end|>
@article{gao2024matten:,
    title={Matten: Video Generation with Mamba-Attention},
    author={Yu Gao, Jiancheng Huang, Xiaopeng Sun, Zequn Jie, Yujie Zhong, Lin Ma},
    journal={arXiv preprint arXiv:2405.03025},
    year={2024},
    archivePrefix={arXiv},
    eprint={2405.03025},
    primaryClass={cs.CV}
}