Image-to-text models Collection of image captioning models Salesforce/blip-image-captioning-large Image-to-Text • 0.5B • Updated Feb 3 • 2.25M • 1.37k microsoft/git-large-coco Image-to-Text • 0.4B • Updated Jun 26, 2023 • 2.63k • 104 Salesforce/instructblip-vicuna-7b Image-Text-to-Text • 8B • Updated Feb 3 • 71.6k • 94 Salesforce/blip2-flan-t5-xxl Image-Text-to-Text • 12B • Updated Feb 3 • 5.7k • 91
SigLIP release SigLIP improves upon CLIP with a sigmoid loss. Both English-only and multilingual checkpoints are released. Sigmoid Loss for Language Image Pre-Training Paper • 2303.15343 • Published Mar 27, 2023 • 8 google/siglip-base-patch16-224 Zero-Shot Image Classification • 0.2B • Updated Sep 26, 2024 • 364k • 56 google/siglip-base-patch16-256 Zero-Shot Image Classification • 0.2B • Updated Sep 26, 2024 • 12.3k • 6 google/siglip-base-patch16-384 Zero-Shot Image Classification • 0.2B • Updated Sep 26, 2024 • 2.46k • 10
google/siglip-base-patch16-224 Zero-Shot Image Classification • 0.2B • Updated Sep 26, 2024 • 364k • 56
google/siglip-base-patch16-256 Zero-Shot Image Classification • 0.2B • Updated Sep 26, 2024 • 12.3k • 6
google/siglip-base-patch16-384 Zero-Shot Image Classification • 0.2B • Updated Sep 26, 2024 • 2.46k • 10
Image-to-text models Collection of image captioning models Salesforce/blip-image-captioning-large Image-to-Text • 0.5B • Updated Feb 3 • 2.25M • 1.37k microsoft/git-large-coco Image-to-Text • 0.4B • Updated Jun 26, 2023 • 2.63k • 104 Salesforce/instructblip-vicuna-7b Image-Text-to-Text • 8B • Updated Feb 3 • 71.6k • 94 Salesforce/blip2-flan-t5-xxl Image-Text-to-Text • 12B • Updated Feb 3 • 5.7k • 91
SigLIP release SigLIP improves upon CLIP with a sigmoid loss. Both English-only and multilingual checkpoints are released. Sigmoid Loss for Language Image Pre-Training Paper • 2303.15343 • Published Mar 27, 2023 • 8 google/siglip-base-patch16-224 Zero-Shot Image Classification • 0.2B • Updated Sep 26, 2024 • 364k • 56 google/siglip-base-patch16-256 Zero-Shot Image Classification • 0.2B • Updated Sep 26, 2024 • 12.3k • 6 google/siglip-base-patch16-384 Zero-Shot Image Classification • 0.2B • Updated Sep 26, 2024 • 2.46k • 10
google/siglip-base-patch16-224 Zero-Shot Image Classification • 0.2B • Updated Sep 26, 2024 • 364k • 56
google/siglip-base-patch16-256 Zero-Shot Image Classification • 0.2B • Updated Sep 26, 2024 • 12.3k • 6
google/siglip-base-patch16-384 Zero-Shot Image Classification • 0.2B • Updated Sep 26, 2024 • 2.46k • 10