Panda-70M is a new large-scale video dataset comprising 70 million high-quality video clips, each paired with textual captions, designed to be used as pre-training for video understanding tasks.
text
Panda-70M is a new large-scale video dataset comprising 70 million high-quality video clips, each paired with textual captions, designed to be used as pre-training for video understanding tasks.
new_line
new_line
Key Points:
text
Key Points:
new_line
* Automatic Caption Generation: Utilizes an automatic pipeline with multiple cross-modality teacher models to generate captions for video clips.
text
* Automatic Caption Generation: Utilizes an automatic pipeline with multiple cross-modality teacher models to generate captions for video clips.
new_line
* Fine-tuned Caption Selection: Employs a fine-tuned retrieval model to select the most appropriate caption from multiple candidates for each video clip.
text
* Fine-tuned Caption Selection: Employs a fine-tuned retrieval model to select the most appropriate caption from multiple candidates for each video clip.
new_line
* Improved Performance: Pre-training on Panda-70M shows significant performance gains in video captioning, text-video retrieval, and text-driven video generation.
text
* Improved Performance: Pre-training on Panda-70M shows significant performance gains in video captioning, text-video retrieval, and text-driven video generation.
new_line
new_line
Paper: 
text
Paper: 
Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachers (2402.19479)
https://huggingface.co/papers/2402.19479
2402.19479
paper
resource
https://huggingface.co/papers/2402.19479
new_line
Project page: 
text
Project page: 
https://snap-research.github.io/Panda-70M/
https://snap-research.github.io/Panda-70M/
link
new_line
Code: 
text
Code: 
https://github.com/snap-research/Panda-70M
https://github.com/snap-research/Panda-70M
link
new_line
new_line
Congrats to the authors 
text
Congrats to the authors 
@tschen
mention
tschen
, 
text
, 
@aliaksandr-siarohin
mention
aliaksandr-siarohin
 et al. for their work!
text
 et al. for their work!
Panda-70M is a new large-scale video dataset comprising 70 million high-quality video clips, each paired with textual captions, designed to be used as pre-training for video understanding tasks.

Key Points:
* Automatic Caption Generation: Utilizes an automatic pipeline with multiple cross-modality teacher models to generate captions for video clips.
* Fine-tuned Caption Selection: Employs a fine-tuned retrieval model to select the most appropriate caption from multiple candidates for each video clip.
* Improved Performance: Pre-training on Panda-70M shows significant performance gains in video captioning, text-video retrieval, and text-driven video generation.

Paper: https://huggingface.co/papers/2402.19479
Project page: https://snap-research.github.io/Panda-70M/
Code: https://github.com/snap-research/Panda-70M

Congrats to the authors @tschen, @aliaksandr-siarohin et al. for their work!
👍
toanvu upleader ajibawa-2023 clem Kernel osanseviero dkgee ankur296 ChavyvAkvar tschen Ayaan-Sharif
❤️
clem osanseviero tschen nisten sbrandeis
65e53e2e2cdbd1f4a30785ac
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/9-X8NlUt6iTeeFy4UoDJZ.png
Lincoln Yin
upleader
user