title: Gemma: Open Models Based on Gemini Research and Technology
summary: This work introduces Gemma, a family of lightweight, state-of-the art open
  models built from the research and technology used to create Gemini models.
  Gemma models demonstrate strong performance across academic benchmarks for
  language understanding, reasoning, and safety. We release two sizes of models
  (2 billion and 7 billion parameters), and provide both pretrained and
  fine-tuned checkpoints. Gemma outperforms similarly sized open models on 11 out
  of 18 text-based tasks, and we present comprehensive evaluations of safety and
  responsibility aspects of the models, alongside a detailed description of model
  development. We believe the responsible release of LLMs is critical for
  improving the safety of frontier models, and for enabling the next wave of LLM
  innovations.
paper_authors._id: 65f26e7030e67a5682a27711
paper_authors.name: Gemma Team
paper_authors._id: 65f26e7030e67a5682a27712
paper_authors.name: Thomas Mesnard
paper_authors._id: 65f26e7030e67a5682a27713
paper_authors.name: Cassidy Hardin
paper_authors._id: 65f26e7030e67a5682a27714
paper_authors.name: Robert Dadashi
paper_authors._id: 65f26e7030e67a5682a27715
paper_authors.name: Surya Bhupatiraju
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-03-14T16:31:54.757Z
paper_authors._id: 65d7644d19bf1e60614dee6e
paper_authors.avatarUrl: /avatars/422a8d28fa9d9ff2c3ec1406352cb346.svg
paper_authors.fullname: Surya Bhupatiraju
paper_authors.type: user
paper_authors.user: suryabhupa
paper_authors._id: 65f26e7030e67a5682a27716
paper_authors.name: Shreya Pathak
paper_authors._id: 65f26e7030e67a5682a27717
paper_authors.name: Laurent Sifre
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-14T08:48:35.664Z
paper_authors._id: 65d74b9b7713dc8fd8956d1c
paper_authors.avatarUrl: /avatars/5d5873861134bb079753c48304a7b7c2.svg
paper_authors.fullname: Laurent Sifre
paper_authors.type: user
paper_authors.user: laurentsifre
paper_authors._id: 65f26e7030e67a5682a27718
paper_authors.name: Morgane Rivière
paper_authors._id: 65f26e7030e67a5682a27719
paper_authors.name: Mihir Sanjay Kale
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-14T08:48:49.954Z
paper_authors._id: 6226953f7551f131b4eba5c5
paper_authors.avatarUrl: /avatars/eec8fa43fc37f546d9fef118a138d8a4.svg
paper_authors.fullname: Mihir Sanjay Kale
paper_authors.type: user
paper_authors.user: mihirkale
paper_authors._id: 65f26e7030e67a5682a2771a
paper_authors.name: Juliette Love
paper_authors._id: 65f26e7030e67a5682a2771b
paper_authors.name: Pouya Tafti
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-14T08:48:59.357Z
paper_authors._id: 6558091ecafc48de36f848a8
paper_authors.avatarUrl: /avatars/3b7e8327d369436d02fe8c58dde036c2.svg
paper_authors.fullname: Pouya Tafti
paper_authors.type: user
paper_authors.user: pdt
paper_authors._id: 65f26e7030e67a5682a2771c
paper_authors.name: Léonard Hussenot
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-03-28T14:22:42.993Z
paper_authors._id: 667a7b2e1764931987803b46
paper_authors.avatarUrl: /avatars/da2ee162f33c681e3d1c4d1e6d44dcbd.svg
paper_authors.fullname: Léonard Hussenot
paper_authors.type: user
paper_authors.user: leonardhussenot
paper_authors._id: 65f26e7030e67a5682a2771d
paper_authors.name: Aakanksha Chowdhery
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-14T08:49:10.366Z
paper_authors._id: 64e3bd0d58579025cbab1199
paper_authors.avatarUrl: /avatars/5c1b733c121be15f121630e8756990d0.svg
paper_authors.fullname: Aakanksha Chowdhery
paper_authors.type: user
paper_authors.user: achowdhery
paper_authors._id: 65f26e7030e67a5682a2771e
paper_authors.name: Adam Roberts
paper_authors._id: 65f26e7030e67a5682a2771f
paper_authors.name: Aditya Barua
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-14T08:49:44.025Z
paper_authors._id: 63cb7741567105596c3f2f05
paper_authors.avatarUrl: /avatars/1c315a936e2ae04fc5b09d786cc899b7.svg
paper_authors.fullname: Aditya
paper_authors.type: user
paper_authors.user: adityabarua
paper_authors._id: 65f26e7030e67a5682a27720
paper_authors.name: Alex Botev
paper_authors._id: 65f26e7030e67a5682a27721
paper_authors.name: Alex Castro-Ros
paper_authors._id: 65f26e7030e67a5682a27722
paper_authors.name: Ambrose Slone
paper_authors._id: 65f26e7030e67a5682a27723
paper_authors.name: Amélie Héliou
paper_authors._id: 65f26e7030e67a5682a27724
paper_authors.name: Andrea Tacchetti
paper_authors._id: 65f26e7030e67a5682a27725
paper_authors.name: Anna Bulanova
paper_authors._id: 65f26e7030e67a5682a27726
paper_authors.name: Antonia Paterson
paper_authors._id: 65f26e7030e67a5682a27727
paper_authors.name: Beth Tsai
paper_authors._id: 65f26e7030e67a5682a27728
paper_authors.name: Bobak Shahriari
paper_authors._id: 65f26e7030e67a5682a27729
paper_authors.name: Charline Le Lan
paper_authors._id: 65f26e7030e67a5682a2772a
paper_authors.name: Christopher A. Choquette-Choo
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-14T08:50:31.382Z
paper_authors._id: 649c5307e89a7650158f4965
paper_authors.avatarUrl: /avatars/3c71b501db27c86ed686ae26ad1391cd.svg
paper_authors.fullname: Christopher A. Choquette-Choo
paper_authors.type: user
paper_authors.user: cchoquette
paper_authors._id: 65f26e7030e67a5682a2772b
paper_authors.name: Clément Crepy
paper_authors._id: 65f26e7030e67a5682a2772c
paper_authors.name: Daniel Cer
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-14T08:50:53.393Z
paper_authors._id: 610dd291dda0cb4dbfbf32d2
paper_authors.avatarUrl: /avatars/6f3fe6d53c37076e2cefc1b4d95743d6.svg
paper_authors.fullname: Daniel Cer
paper_authors.type: user
paper_authors.user: danielcer
paper_authors._id: 65f26e7030e67a5682a2772d
paper_authors.name: Daphne Ippolito
paper_authors._id: 65f26e7030e67a5682a2772e
paper_authors.name: David Reid
paper_authors._id: 65f26e7030e67a5682a2772f
paper_authors.name: Elena Buchatskaya
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-14T08:51:15.733Z
paper_authors._id: 65da0ecba37e8a543ab732ca
paper_authors.avatarUrl: /avatars/90889950d8c5e0089ada6b3707104a87.svg
paper_authors.fullname: Elena Buchatskaya
paper_authors.type: user
paper_authors.user: ebuchatskaya
paper_authors._id: 65f26e7030e67a5682a27730
paper_authors.name: Eric Ni
paper_authors._id: 65f26e7030e67a5682a27731
paper_authors.name: Eric Noland
paper_authors._id: 65f26e7030e67a5682a27732
paper_authors.name: Geng Yan
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-03-14T13:23:23.069Z
paper_authors._id: 65f2f6e325b848bd06175cb1
paper_authors.avatarUrl: /avatars/157b908c632dc81bce331805931239e6.svg
paper_authors.fullname: Geng Yan
paper_authors.type: user
paper_authors.user: gengyan
paper_authors._id: 65f26e7030e67a5682a27733
paper_authors.name: George Tucker
paper_authors._id: 65f26e7030e67a5682a27734
paper_authors.name: George-Christian Muraru
paper_authors._id: 65f26e7030e67a5682a27735
paper_authors.name: Grigory Rozhdestvenskiy
paper_authors._id: 65f26e7030e67a5682a27736
paper_authors.name: Henryk Michalewski
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-14T08:51:55.812Z
paper_authors._id: 6343ead529de2293e7e01889
paper_authors.avatarUrl: /avatars/dc141ec176bf8b23306be64dbb5b22d1.svg
paper_authors.fullname: Henryk Michalewski
paper_authors.type: user
paper_authors.user: henrykmichalewski
paper_authors._id: 65f26e7030e67a5682a27737
paper_authors.name: Ian Tenney
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-14T08:52:03.791Z
paper_authors._id: 615b839cae7584e90d765049
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/1633387368708-noauth.jpeg
paper_authors.fullname: Ian Tenney
paper_authors.type: user
paper_authors.user: iftenney
paper_authors._id: 65f26e7030e67a5682a27738
paper_authors.name: Ivan Grishchenko
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-10-22T08:03:43.719Z
paper_authors._id: 6625f323495f5402565e8f2e
paper_authors.avatarUrl: /avatars/f43610554b269b113ac78eb590265860.svg
paper_authors.fullname: Ivan Grishchenko
paper_authors.type: user
paper_authors.user: igrishchenko
paper_authors._id: 65f26e7030e67a5682a27739
paper_authors.name: Jacob Austin
paper_authors._id: 65f26e7030e67a5682a2773a
paper_authors.name: James Keeling
paper_authors._id: 65f26e7030e67a5682a2773b
paper_authors.name: Jane Labanowski
paper_authors._id: 65f26e7030e67a5682a2773c
paper_authors.name: Jean-Baptiste Lespiau
paper_authors._id: 65f26e7030e67a5682a2773d
paper_authors.name: Jeff Stanway
paper_authors._id: 65f26e7030e67a5682a2773e
paper_authors.name: Jenny Brennan
paper_authors._id: 65f26e7030e67a5682a2773f
paper_authors.name: Jeremy Chen
paper_authors._id: 65f26e7030e67a5682a27740
paper_authors.name: Johan Ferret
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-14T08:53:03.109Z
paper_authors._id: 65afb7dbdd6bdfd73cd8e609
paper_authors.avatarUrl: /avatars/b21069bc2d7ee4cc1508008e3c8ade64.svg
paper_authors.fullname: Johan Ferret
paper_authors.type: user
paper_authors.user: ferretj
paper_authors._id: 65f26e7030e67a5682a27741
paper_authors.name: Justin Chiu
paper_authors._id: 65f26e7030e67a5682a27742
paper_authors.name: Justin Mao-Jones
paper_authors._id: 65f26e7030e67a5682a27743
paper_authors.name: Katherine Lee
paper_authors._id: 65f26e7030e67a5682a27744
paper_authors.name: Kathy Yu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-14T08:58:18.878Z
paper_authors._id: 650200f0cccc7b28a34bb6b3
paper_authors.avatarUrl: /avatars/32b680c459b0346e619145d45ae463d3.svg
paper_authors.fullname: Kathy Yu
paper_authors.type: user
paper_authors.user: kathy-yu
paper_authors._id: 65f26e7030e67a5682a27745
paper_authors.name: Katie Millican
paper_authors._id: 65f26e7030e67a5682a27746
paper_authors.name: Lars Lowe Sjoesund
paper_authors._id: 65f26e7030e67a5682a27747
paper_authors.name: Lisa Lee
paper_authors._id: 65f26e7030e67a5682a27748
paper_authors.name: Lucas Dixon
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-14T08:59:42.368Z
paper_authors._id: 64c25a9c2b1ffc2eecbce31d
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/64c25a9c2b1ffc2eecbce31d/uTp3yOPdmCSAmhzWwKUjK.png
paper_authors.fullname: Lucas Dixon
paper_authors.type: user
paper_authors.user: iislucas
paper_authors._id: 65f26e7030e67a5682a27749
paper_authors.name: Machel Reid
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-14T08:58:41.633Z
paper_authors._id: 612d7a89ce7c3822c425d044
paper_authors.avatarUrl: /avatars/8c050ceea27309cb2d7ab3b9742dc8e6.svg
paper_authors.fullname: Machel Reid
paper_authors.type: user
paper_authors.user: machelreid
paper_authors._id: 65f26e7030e67a5682a2774a
paper_authors.name: Maciej Mikuła
paper_authors._id: 65f26e7030e67a5682a2774b
paper_authors.name: Mateo Wirth
paper_authors._id: 65f26e7030e67a5682a2774c
paper_authors.name: Michael Sharman
paper_authors._id: 65f26e7030e67a5682a2774d
paper_authors.name: Nikolai Chinaev
paper_authors._id: 65f26e7030e67a5682a2774e
paper_authors.name: Nithum Thain
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-14T08:58:06.247Z
paper_authors._id: 652853b57149f9d1968a056d
paper_authors.avatarUrl: /avatars/9d8fc754b5b04d2fd89979401460f1df.svg
paper_authors.fullname: Nithum Thain
paper_authors.type: user
paper_authors.user: nitht
paper_authors._id: 65f26e7030e67a5682a2774f
paper_authors.name: Olivier Bachem
paper_authors._id: 65f26e7030e67a5682a27750
paper_authors.name: Oscar Chang
paper_authors._id: 65f26e7030e67a5682a27751
paper_authors.name: Oscar Wahltinez
paper_authors._id: 65f26e7030e67a5682a27752
paper_authors.name: Paige Bailey
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-14T08:57:42.483Z
paper_authors._id: 60f300249b7e6dcb17723f3a
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/1642442497120-60f300249b7e6dcb17723f3a.jpeg
paper_authors.fullname: Paige Bailey
paper_authors.type: user
paper_authors.user: dynamicwebpaige
paper_authors._id: 65f26e7030e67a5682a27753
paper_authors.name: Paul Michel
paper_authors._id: 65f26e7030e67a5682a27754
paper_authors.name: Petko Yotov
paper_authors._id: 65f26e7030e67a5682a27755
paper_authors.name: Pier Giuseppe Sessa
paper_authors._id: 65f26e7030e67a5682a27756
paper_authors.name: Rahma Chaabouni
paper_authors._id: 65f26e7030e67a5682a27757
paper_authors.name: Ramona Comanescu
paper_authors._id: 65f26e7030e67a5682a27758
paper_authors.name: Reena Jana
paper_authors._id: 65f26e7030e67a5682a27759
paper_authors.name: Rohan Anil
paper_authors._id: 65f26e7030e67a5682a2775a
paper_authors.name: Ross McIlroy
paper_authors._id: 65f26e7030e67a5682a2775b
paper_authors.name: Ruibo Liu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-14T08:57:26.181Z
paper_authors._id: 5e91f1554957053f606489ff
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/5e91f1554957053f606489ff/eJty7TksRLwuta0deZTmt.jpeg
paper_authors.fullname: Ruibo Liu
paper_authors.type: user
paper_authors.user: agi-css
paper_authors._id: 65f26e7030e67a5682a2775c
paper_authors.name: Ryan Mullins
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-03-28T08:39:26.796Z
paper_authors._id: 65a402a53522df7a27125823
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/65a402a53522df7a27125823/tVR6lZlKmjPqi7dTZBGoS.jpeg
paper_authors.fullname: Ryan Mullins
paper_authors.type: user
paper_authors.user: RyanMullins
paper_authors._id: 65f26e7030e67a5682a2775d
paper_authors.name: Samuel L Smith
paper_authors._id: 65f26e7030e67a5682a2775e
paper_authors.name: Sebastian Borgeaud
paper_authors._id: 65f26e7030e67a5682a2775f
paper_authors.name: Sertan Girgin
paper_authors._id: 65f26e7030e67a5682a27760
paper_authors.name: Sholto Douglas
paper_authors._id: 65f26e7030e67a5682a27761
paper_authors.name: Shree Pandya
paper_authors._id: 65f26e7030e67a5682a27762
paper_authors.name: Siamak Shakeri
paper_authors._id: 65f26e7030e67a5682a27763
paper_authors.name: Soham De
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-04-28T13:50:25.430Z
paper_authors._id: 661415d9f9e58fe02bd8661d
paper_authors.avatarUrl: /avatars/7a28bb507b8bac72a8b161e774b19fbd.svg
paper_authors.fullname: Soham De
paper_authors.type: user
paper_authors.user: sohamde
paper_authors._id: 65f26e7030e67a5682a27764
paper_authors.name: Ted Klimenko
paper_authors._id: 65f26e7030e67a5682a27765
paper_authors.name: Tom Hennigan
paper_authors._id: 65f26e7030e67a5682a27766
paper_authors.name: Vlad Feinberg
paper_authors._id: 65f26e7030e67a5682a27767
paper_authors.name: Wojciech Stokowiec
paper_authors._id: 65f26e7030e67a5682a27768
paper_authors.name: Yu-hui Chen
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-14T08:56:28.088Z
paper_authors._id: 65b98ed22f2022969fc25d3b
paper_authors.avatarUrl: /avatars/7dd50758944d120acda7b7d0287c5f7a.svg
paper_authors.fullname: Yu-Hui Chen
paper_authors.type: user
paper_authors.user: yuhuichen1015
paper_authors._id: 65f26e7030e67a5682a27769
paper_authors.name: Zafarali Ahmed
paper_authors._id: 65f26e7030e67a5682a2776a
paper_authors.name: Zhitao Gong
paper_authors._id: 65f26e7030e67a5682a2776b
paper_authors.name: Tris Warkentin
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-14T08:56:06.639Z
paper_authors._id: 64d51be85e5f05485ca50751
paper_authors.avatarUrl: /avatars/5802fcc5a5f1e089df41232892f8f502.svg
paper_authors.fullname: Tris Warkentin
paper_authors.type: user
paper_authors.user: trisfromgoogle
paper_authors._id: 65f26e7030e67a5682a2776c
paper_authors.name: Ludovic Peran
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-14T08:55:47.728Z
paper_authors._id: 60e473dcdefbf317ecd88035
paper_authors.avatarUrl: /avatars/e5c069e6cfc73ea5d3d6c2a437490cdd.svg
paper_authors.fullname: LUDOVIC PERAN
paper_authors.type: user
paper_authors.user: LudovicPeran
paper_authors._id: 65f26e7030e67a5682a2776d
paper_authors.name: Minh Giang
paper_authors._id: 65f26e7030e67a5682a2776e
paper_authors.name: Clément Farabet
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-14T08:55:35.213Z
paper_authors._id: 638a689ef560ea995b57aad4
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/1670015109688-noauth.jpeg
paper_authors.fullname: Clement Farabet
paper_authors.type: user
paper_authors.user: clmnt
paper_authors._id: 65f26e7030e67a5682a2776f
paper_authors.name: Oriol Vinyals
paper_authors._id: 65f26e7030e67a5682a27770
paper_authors.name: Jeff Dean
paper_authors._id: 65f26e7030e67a5682a27771
paper_authors.name: Koray Kavukcuoglu
paper_authors._id: 65f26e7030e67a5682a27772
paper_authors.name: Demis Hassabis
paper_authors._id: 65f26e7030e67a5682a27773
paper_authors.name: Zoubin Ghahramani
paper_authors._id: 65f26e7030e67a5682a27774
paper_authors.name: Douglas Eck
paper_authors._id: 65f26e7030e67a5682a27775
paper_authors.name: Joelle Barral
paper_authors._id: 65f26e7030e67a5682a27776
paper_authors.name: Fernando Pereira
paper_authors._id: 65f26e7030e67a5682a27777
paper_authors.name: Eli Collins
paper_authors._id: 65f26e7030e67a5682a27778
paper_authors.name: Armand Joulin
paper_authors._id: 65f26e7030e67a5682a27779
paper_authors.name: Noah Fiedel
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-14T08:54:30.108Z
paper_authors._id: 62f82ebd870a3f98bbf9e62a
paper_authors.avatarUrl: /avatars/3b03299e128abf2c8ba82db704855de7.svg
paper_authors.fullname: Noah Fiedel
paper_authors.type: user
paper_authors.user: nfiedel
paper_authors._id: 65f26e7030e67a5682a2777a
paper_authors.name: Evan Senter
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-14T08:54:06.474Z
paper_authors._id: 62a47ec0fdd7a13aac264904
paper_authors.avatarUrl: /avatars/f2ff23645203ed2399cfe8b447af437a.svg
paper_authors.fullname: Evan Senter
paper_authors.type: user
paper_authors.user: evansenter
paper_authors._id: 65f26e7030e67a5682a2777b
paper_authors.name: Alek Andreev
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-14T08:53:58.001Z
paper_authors._id: 65d667858ac5cf899e3b66c4
paper_authors.avatarUrl: /avatars/340468ee8cd9125eceae23a9b8e536a5.svg
paper_authors.fullname: Alek Andreev
paper_authors.type: user
paper_authors.user: alekandreev
paper_authors._id: 65f26e7030e67a5682a2777c
paper_authors.name: Kathleen Kenealy
paper_title: Gemma: Open Models Based on Gemini Research and Technology
paper_summary: This work introduces Gemma, a family of lightweight, state-of-the art open
  models built from the research and technology used to create Gemini models.
  Gemma models demonstrate strong performance across academic benchmarks for
  language understanding, reasoning, and safety. We release two sizes of models
  (2 billion and 7 billion parameters), and provide both pretrained and
  fine-tuned checkpoints. Gemma outperforms similarly sized open models on 11 out
  of 18 text-based tasks, and we present comprehensive evaluations of safety and
  responsibility aspects of the models, alongside a detailed description of model
  development. We believe the responsible release of LLMs is critical for
  improving the safety of frontier models, and for enabling the next wave of LLM
  innovations.
paper_ai_summary: Gemma, a family of lightweight and high-performing language models, outperforms similarly sized open models across text-based tasks and emphasizes the importance of responsible model development and safety.
paper_ai_keywords: lightweight state-of-the art open models Gemma Gemini models language understanding reasoning safety pretrained fine-tuned checkpoints LLMs text-based tasks blameability responsibility aspects model development