title: PaliGemma: A versatile 3B VLM for transfer
summary: PaliGemma is an open Vision-Language Model (VLM) that is based on the
  SigLIP-So400m vision encoder and the Gemma-2B language model. It is trained to
  be a versatile and broadly knowledgeable base model that is effective to
  transfer. It achieves strong performance on a wide variety of open-world tasks.
  We evaluate PaliGemma on almost 40 diverse tasks including standard VLM
  benchmarks, but also more specialized tasks such as remote-sensing and
  segmentation.
paper_authors._id: 668f4967f65238b10c6b12b7
paper_authors.name: Lucas Beyer
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-11T08:43:35.767Z
paper_authors._id: 642d334ff65714b4585f2de4
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/642d334ff65714b4585f2de4/gxBynq5KyoUP0VlAQD3-w.jpeg
paper_authors.fullname: Lucas Beyer
paper_authors.type: user
paper_authors.user: giffmana
paper_authors._id: 668f4967f65238b10c6b12b8
paper_authors.name: Andreas Steiner
paper_authors._id: 668f4967f65238b10c6b12b9
paper_authors.name: André Susano Pinto
paper_authors._id: 668f4967f65238b10c6b12ba
paper_authors.name: Alexander Kolesnikov
paper_authors._id: 668f4967f65238b10c6b12bb
paper_authors.name: Xiao Wang
paper_authors._id: 668f4967f65238b10c6b12bc
paper_authors.name: Daniel Salz
paper_authors._id: 668f4967f65238b10c6b12bd
paper_authors.name: Maxim Neumann
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-11T08:46:01.880Z
paper_authors._id: 65a9196f9fa2a0f9a2d27759
paper_authors.avatarUrl: /avatars/fe274d04b2ff7d8a079cdde6a77395c4.svg
paper_authors.fullname: Maxim Neumann
paper_authors.type: user
paper_authors.user: maximn
paper_authors._id: 668f4967f65238b10c6b12be
paper_authors.name: Ibrahim Alabdulmohsin
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-11T08:46:09.539Z
paper_authors._id: 630545da20668afe24860235
paper_authors.avatarUrl: /avatars/5d82be2e7412bff1af15cc5eafa60b7d.svg
paper_authors.fullname: Ibrahim Alabdulmohsin
paper_authors.type: user
paper_authors.user: ibomohsin
paper_authors._id: 668f4967f65238b10c6b12bf
paper_authors.name: Michael Tschannen
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-11T08:46:36.803Z
paper_authors._id: 6489893e1ec8356ba5bb9777
paper_authors.avatarUrl: /avatars/54354c1e5774cadd1d83d42054e9d96b.svg
paper_authors.fullname: Michael Tschannen
paper_authors.type: user
paper_authors.user: mitsch
paper_authors._id: 668f4967f65238b10c6b12c0
paper_authors.name: Emanuele Bugliarello
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-11T08:46:45.351Z
paper_authors._id: 626a9284783d5891f45beb53
paper_authors.avatarUrl: /avatars/8737662babc5d42cafba6087ab33e716.svg
paper_authors.fullname: Emanuele Bugliarello
paper_authors.type: user
paper_authors.user: e-bug
paper_authors._id: 668f4967f65238b10c6b12c1
paper_authors.name: Thomas Unterthiner
paper_authors._id: 668f4967f65238b10c6b12c2
paper_authors.name: Daniel Keysers
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-11T08:47:05.769Z
paper_authors._id: 662fc73ccee11621a1067db1
paper_authors.avatarUrl: /avatars/4fbfbc0621f631d8e95a2a642fa0cd27.svg
paper_authors.fullname: Daniel Keysers
paper_authors.type: user
paper_authors.user: dkeysers
paper_authors._id: 668f4967f65238b10c6b12c3
paper_authors.name: Skanda Koppula
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-11T08:47:12.071Z
paper_authors._id: 65451016321f0393f453cd7b
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/XBmF81Uyj0N7lPclU1pUG.jpeg
paper_authors.fullname: Skanda Koppula
paper_authors.type: user
paper_authors.user: skoppula
paper_authors._id: 668f4967f65238b10c6b12c4
paper_authors.name: Fangyu Liu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-11T08:47:30.850Z
paper_authors._id: 5f881856ee5616341bc51e67
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/5f881856ee5616341bc51e67/9UCZCuhBTpJC9tGPyGmMb.jpeg
paper_authors.fullname: Fangyu Liu
paper_authors.type: user
paper_authors.user: fl399
paper_authors._id: 668f4967f65238b10c6b12c5
paper_authors.name: Adam Grycner
paper_authors._id: 668f4967f65238b10c6b12c6
paper_authors.name: Alexey Gritsenko
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-11T08:47:44.594Z
paper_authors._id: 62d8f9887b8dc0ba17271415
paper_authors.avatarUrl: /avatars/12ec78d34fd849bad44217b212f31e98.svg
paper_authors.fullname: Alexey Gritsenko
paper_authors.type: user
paper_authors.user: AlexeyG
paper_authors._id: 668f4967f65238b10c6b12c7
paper_authors.name: Neil Houlsby
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-11T08:47:51.045Z
paper_authors._id: 64a2c7f263f69fb98d3bfdb4
paper_authors.avatarUrl: /avatars/a362a236c0654b7605dcb7673e309335.svg
paper_authors.fullname: Neil Houlsby
paper_authors.type: user
paper_authors.user: neilhoulsby
paper_authors._id: 668f4967f65238b10c6b12c8
paper_authors.name: Manoj Kumar
paper_authors._id: 668f4967f65238b10c6b12c9
paper_authors.name: Keran Rong
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-02-13T08:27:11.967Z
paper_authors._id: 648a9083abcf427a9a498679
paper_authors.avatarUrl: /avatars/e32d413ce0a48d83f95e29c11a8a8ae8.svg
paper_authors.fullname: Keran 
paper_authors.type: user
paper_authors.user: Keeera
paper_authors._id: 668f4967f65238b10c6b12ca
paper_authors.name: Julian Eisenschlos
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-11T08:48:23.777Z
paper_authors._id: 640f5502a92fedb0e8511d66
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/640f5502a92fedb0e8511d66/3CFOBG_gm4WlQpQXXaQlr.jpeg
paper_authors.fullname: Julian Eisenschlos
paper_authors.type: user
paper_authors.user: eisenjulian
paper_authors._id: 668f4967f65238b10c6b12cb
paper_authors.name: Rishabh Kabra
paper_authors._id: 668f4967f65238b10c6b12cc
paper_authors.name: Matthias Bauer
paper_authors._id: 668f4967f65238b10c6b12cd
paper_authors.name: Matko Bošnjak
paper_authors._id: 668f4967f65238b10c6b12ce
paper_authors.name: Xi Chen
paper_authors._id: 668f4967f65238b10c6b12cf
paper_authors.name: Matthias Minderer
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-11T08:48:54.125Z
paper_authors._id: 649ac6e57c36fc2dc6e6b0f4
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/649ac6e57c36fc2dc6e6b0f4/Scd3LiYW5Y2qunDDHnPWw.jpeg
paper_authors.fullname: Matthias Minderer
paper_authors.type: user
paper_authors.user: mjlm
paper_authors._id: 668f4967f65238b10c6b12d0
paper_authors.name: Paul Voigtlaender
paper_authors._id: 668f4967f65238b10c6b12d1
paper_authors.name: Ioana Bica
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-11T08:51:40.141Z
paper_authors._id: 666b0b1b0bc0ed84ea63b2e0
paper_authors.avatarUrl: /avatars/0538f1c8a26d1afa1be90e3082c3791c.svg
paper_authors.fullname: Ioana Bica
paper_authors.type: user
paper_authors.user: ioanabica
paper_authors._id: 668f4967f65238b10c6b12d2
paper_authors.name: Ivana Balazevic
paper_authors._id: 668f4967f65238b10c6b12d3
paper_authors.name: Joan Puigcerver
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-11T08:51:19.650Z
paper_authors._id: 64afea8efd620c8a7ad4ebd7
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/64afea8efd620c8a7ad4ebd7/O3e9nLirWFVZ_jMN4lFdH.jpeg
paper_authors.fullname: Joan Puigcerver
paper_authors.type: user
paper_authors.user: joapuipe
paper_authors._id: 668f4967f65238b10c6b12d4
paper_authors.name: Pinelopi Papalampidi
paper_authors._id: 668f4967f65238b10c6b12d5
paper_authors.name: Olivier Henaff
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-11T08:50:57.596Z
paper_authors._id: 64f30d8ceb5f2982081db604
paper_authors.avatarUrl: /avatars/eedf65a104d099d8a60bbffe69bc2571.svg
paper_authors.fullname: Olivier Henaff
paper_authors.type: user
paper_authors.user: olivierhenaff
paper_authors._id: 668f4967f65238b10c6b12d6
paper_authors.name: Xi Xiong
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-11T16:23:51.810Z
paper_authors._id: 661bb651d9dc3639eb837e0c
paper_authors.avatarUrl: /avatars/d038fb872833c66925f77db7d4baa559.svg
paper_authors.fullname: Xi Xiong
paper_authors.type: user
paper_authors.user: alzmxx
paper_authors._id: 668f4967f65238b10c6b12d7
paper_authors.name: Radu Soricut
paper_authors._id: 668f4967f65238b10c6b12d8
paper_authors.name: Jeremiah Harmsen
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-11T08:50:30.918Z
paper_authors._id: 65d77c0e1e7686c460255fda
paper_authors.avatarUrl: /avatars/1d26a7a7ffdc5ca9e67b97030f21b098.svg
paper_authors.fullname: Jeremiah Harmsen
paper_authors.type: user
paper_authors.user: jharmsen
paper_authors._id: 668f4967f65238b10c6b12d9
paper_authors.name: Xiaohua Zhai
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-11T08:50:23.887Z
paper_authors._id: 65dcd90082bddd501f68174b
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/M2bc9PyKeFs1cCXjTfGGq.jpeg
paper_authors.fullname: Xiaohua Zhai
paper_authors.type: user
paper_authors.user: xiaohuazhai
paper_title: PaliGemma: A versatile 3B VLM for transfer
paper_summary: PaliGemma is an open Vision-Language Model (VLM) that is based on the
  SigLIP-So400m vision encoder and the Gemma-2B language model. It is trained to
  be a versatile and broadly knowledgeable base model that is effective to
  transfer. It achieves strong performance on a wide variety of open-world tasks.
  We evaluate PaliGemma on almost 40 diverse tasks including standard VLM
  benchmarks, but also more specialized tasks such as remote-sensing and
  segmentation.
paper_ai_summary: PaliGemma, a versatile Vision-Language Model based on SigLIP-So400m and Gemma-2B, demonstrates strong performance across numerous open-world tasks, including specialized areas like remote sensing and segmentation.
paper_ai_keywords: Vision-Language Model SigLIP-So400m Gemma-2B