Online pre-training with long-form videos
<|reference_start|>Online pre-training with long-form videos: In this study, we investigate the impact of online pre-training with continuous video clips. We will examine three methods for pre-training (masked image modeling, contrastive learning, and knowledge distillation), and assess the performance on downstream action recognition tasks. As a result, online pre-training with contrast learning showed the highest performance in downstream tasks. Our findings suggest that learning from long-form videos can be helpful for action recognition with short videos.<|reference_end|>
@article{kato2024online,
    title={Online pre-training with long-form videos},
    author={Itsuki Kato, Kodai Kamiya, Toru Tamaki},
    journal={arXiv preprint arXiv:2408.15651},
    year={2024},
    archivePrefix={arXiv},
    eprint={2408.15651},
    primaryClass={cs.CV}
}