Gemma: Open Models Based on Gemini Research and Technology
This work introduces Gemma, a family of lightweight, state-of-the art open
models built from the research and technology used to create Gemini models.
Gemma models demonstrate strong performance across academic benchmarks for
language understanding, reasoning, and safety. We release two sizes of models
(2 billion and 7 billion parameters), and provide both pretrained and
fine-tuned checkpoints. Gemma outperforms similarly sized open models on 11 out
of 18 text-based tasks, and we present comprehensive evaluations of safety and
responsibility aspects of the models, alongside a detailed description of model
development. We believe the responsible release of LLMs is critical for
improving the safety of frontier models, and for enabling the next wave of LLM
innovations.
65f26e7030e67a5682a27711
Gemma Team
65f26e7030e67a5682a27712
Thomas Mesnard
65f26e7030e67a5682a27713
Cassidy Hardin
65f26e7030e67a5682a27714
Robert Dadashi
65f26e7030e67a5682a27715
Surya Bhupatiraju
claimed_verified
2024-03-14T16:31:54.757Z
65d7644d19bf1e60614dee6e
/avatars/422a8d28fa9d9ff2c3ec1406352cb346.svg
Surya Bhupatiraju
user
suryabhupa
65f26e7030e67a5682a27716
Shreya Pathak
65f26e7030e67a5682a27717
Laurent Sifre
admin_assigned
2024-03-14T08:48:35.664Z
65d74b9b7713dc8fd8956d1c
/avatars/5d5873861134bb079753c48304a7b7c2.svg
Laurent Sifre
user
laurentsifre
65f26e7030e67a5682a27718
Morgane Rivière
65f26e7030e67a5682a27719
Mihir Sanjay Kale
admin_assigned
2024-03-14T08:48:49.954Z
6226953f7551f131b4eba5c5
/avatars/eec8fa43fc37f546d9fef118a138d8a4.svg
Mihir Sanjay Kale
user
mihirkale
65f26e7030e67a5682a2771a
Juliette Love
65f26e7030e67a5682a2771b
Pouya Tafti
admin_assigned
2024-03-14T08:48:59.357Z
6558091ecafc48de36f848a8
/avatars/3b7e8327d369436d02fe8c58dde036c2.svg
Pouya Tafti
user
pdt
65f26e7030e67a5682a2771c
Léonard Hussenot
claimed_verified
2025-03-28T14:22:42.993Z
667a7b2e1764931987803b46
/avatars/da2ee162f33c681e3d1c4d1e6d44dcbd.svg
Léonard Hussenot
user
leonardhussenot
65f26e7030e67a5682a2771d
Aakanksha Chowdhery
admin_assigned
2024-03-14T08:49:10.366Z
64e3bd0d58579025cbab1199
/avatars/5c1b733c121be15f121630e8756990d0.svg
Aakanksha Chowdhery
user
achowdhery
65f26e7030e67a5682a2771e
Adam Roberts
65f26e7030e67a5682a2771f
Aditya Barua
admin_assigned
2024-03-14T08:49:44.025Z
63cb7741567105596c3f2f05
/avatars/1c315a936e2ae04fc5b09d786cc899b7.svg
Aditya
user
adityabarua
65f26e7030e67a5682a27720
Alex Botev
65f26e7030e67a5682a27721
Alex Castro-Ros
65f26e7030e67a5682a27722
Ambrose Slone
65f26e7030e67a5682a27723
Amélie Héliou
65f26e7030e67a5682a27724
Andrea Tacchetti
65f26e7030e67a5682a27725
Anna Bulanova
65f26e7030e67a5682a27726
Antonia Paterson
65f26e7030e67a5682a27727
Beth Tsai
65f26e7030e67a5682a27728
Bobak Shahriari
65f26e7030e67a5682a27729
Charline Le Lan
65f26e7030e67a5682a2772a
Christopher A. Choquette-Choo
admin_assigned
2024-03-14T08:50:31.382Z
649c5307e89a7650158f4965
/avatars/3c71b501db27c86ed686ae26ad1391cd.svg
Christopher A. Choquette-Choo
user
cchoquette
65f26e7030e67a5682a2772b
Clément Crepy
65f26e7030e67a5682a2772c
Daniel Cer
admin_assigned
2024-03-14T08:50:53.393Z
610dd291dda0cb4dbfbf32d2
/avatars/6f3fe6d53c37076e2cefc1b4d95743d6.svg
Daniel Cer
user
danielcer
65f26e7030e67a5682a2772d
Daphne Ippolito
65f26e7030e67a5682a2772e
David Reid
65f26e7030e67a5682a2772f
Elena Buchatskaya
admin_assigned
2024-03-14T08:51:15.733Z
65da0ecba37e8a543ab732ca
/avatars/90889950d8c5e0089ada6b3707104a87.svg
Elena Buchatskaya
user
ebuchatskaya
65f26e7030e67a5682a27730
Eric Ni
65f26e7030e67a5682a27731
Eric Noland
65f26e7030e67a5682a27732
Geng Yan
claimed_verified
2024-03-14T13:23:23.069Z
65f2f6e325b848bd06175cb1
/avatars/157b908c632dc81bce331805931239e6.svg
Geng Yan
user
gengyan
65f26e7030e67a5682a27733
George Tucker
65f26e7030e67a5682a27734
George-Christian Muraru
65f26e7030e67a5682a27735
Grigory Rozhdestvenskiy
65f26e7030e67a5682a27736
Henryk Michalewski
admin_assigned
2024-03-14T08:51:55.812Z
6343ead529de2293e7e01889
/avatars/dc141ec176bf8b23306be64dbb5b22d1.svg
Henryk Michalewski
user
henrykmichalewski
65f26e7030e67a5682a27737
Ian Tenney
admin_assigned
2024-03-14T08:52:03.791Z
615b839cae7584e90d765049
https://cdn-avatars.huggingface.co/v1/production/uploads/1633387368708-noauth.jpeg
Ian Tenney
user
iftenney
65f26e7030e67a5682a27738
Ivan Grishchenko
claimed_verified
2024-10-22T08:03:43.719Z
6625f323495f5402565e8f2e
/avatars/f43610554b269b113ac78eb590265860.svg
Ivan Grishchenko
user
igrishchenko
65f26e7030e67a5682a27739
Jacob Austin
65f26e7030e67a5682a2773a
James Keeling
65f26e7030e67a5682a2773b
Jane Labanowski
65f26e7030e67a5682a2773c
Jean-Baptiste Lespiau
65f26e7030e67a5682a2773d
Jeff Stanway
65f26e7030e67a5682a2773e
Jenny Brennan
65f26e7030e67a5682a2773f
Jeremy Chen
65f26e7030e67a5682a27740
Johan Ferret
admin_assigned
2024-03-14T08:53:03.109Z
65afb7dbdd6bdfd73cd8e609
/avatars/b21069bc2d7ee4cc1508008e3c8ade64.svg
Johan Ferret
user
ferretj
65f26e7030e67a5682a27741
Justin Chiu
65f26e7030e67a5682a27742
Justin Mao-Jones
65f26e7030e67a5682a27743
Katherine Lee
65f26e7030e67a5682a27744
Kathy Yu
admin_assigned
2024-03-14T08:58:18.878Z
650200f0cccc7b28a34bb6b3
/avatars/32b680c459b0346e619145d45ae463d3.svg
Kathy Yu
user
kathy-yu
65f26e7030e67a5682a27745
Katie Millican
65f26e7030e67a5682a27746
Lars Lowe Sjoesund
65f26e7030e67a5682a27747
Lisa Lee
65f26e7030e67a5682a27748
Lucas Dixon
admin_assigned
2024-03-14T08:59:42.368Z
64c25a9c2b1ffc2eecbce31d
https://cdn-avatars.huggingface.co/v1/production/uploads/64c25a9c2b1ffc2eecbce31d/uTp3yOPdmCSAmhzWwKUjK.png
Lucas Dixon
user
iislucas
65f26e7030e67a5682a27749
Machel Reid
admin_assigned
2024-03-14T08:58:41.633Z
612d7a89ce7c3822c425d044
/avatars/8c050ceea27309cb2d7ab3b9742dc8e6.svg
Machel Reid
user
machelreid
65f26e7030e67a5682a2774a
Maciej Mikuła
65f26e7030e67a5682a2774b
Mateo Wirth
65f26e7030e67a5682a2774c
Michael Sharman
65f26e7030e67a5682a2774d
Nikolai Chinaev
65f26e7030e67a5682a2774e
Nithum Thain
admin_assigned
2024-03-14T08:58:06.247Z
652853b57149f9d1968a056d
/avatars/9d8fc754b5b04d2fd89979401460f1df.svg
Nithum Thain
user
nitht
65f26e7030e67a5682a2774f
Olivier Bachem
65f26e7030e67a5682a27750
Oscar Chang
65f26e7030e67a5682a27751
Oscar Wahltinez
65f26e7030e67a5682a27752
Paige Bailey
admin_assigned
2024-03-14T08:57:42.483Z
60f300249b7e6dcb17723f3a
https://cdn-avatars.huggingface.co/v1/production/uploads/1642442497120-60f300249b7e6dcb17723f3a.jpeg
Paige Bailey
user
dynamicwebpaige
65f26e7030e67a5682a27753
Paul Michel
65f26e7030e67a5682a27754
Petko Yotov
65f26e7030e67a5682a27755
Pier Giuseppe Sessa
65f26e7030e67a5682a27756
Rahma Chaabouni
65f26e7030e67a5682a27757
Ramona Comanescu
65f26e7030e67a5682a27758
Reena Jana
65f26e7030e67a5682a27759
Rohan Anil
65f26e7030e67a5682a2775a
Ross McIlroy
65f26e7030e67a5682a2775b
Ruibo Liu
admin_assigned
2024-03-14T08:57:26.181Z
5e91f1554957053f606489ff
https://cdn-avatars.huggingface.co/v1/production/uploads/5e91f1554957053f606489ff/eJty7TksRLwuta0deZTmt.jpeg
Ruibo Liu
user
agi-css
65f26e7030e67a5682a2775c
Ryan Mullins
claimed_verified
2025-03-28T08:39:26.796Z
65a402a53522df7a27125823
https://cdn-avatars.huggingface.co/v1/production/uploads/65a402a53522df7a27125823/tVR6lZlKmjPqi7dTZBGoS.jpeg
Ryan Mullins
user
RyanMullins
65f26e7030e67a5682a2775d
Samuel L Smith
65f26e7030e67a5682a2775e
Sebastian Borgeaud
65f26e7030e67a5682a2775f
Sertan Girgin
65f26e7030e67a5682a27760
Sholto Douglas
65f26e7030e67a5682a27761
Shree Pandya
65f26e7030e67a5682a27762
Siamak Shakeri
65f26e7030e67a5682a27763
Soham De
claimed_verified
2025-04-28T13:50:25.430Z
661415d9f9e58fe02bd8661d
/avatars/7a28bb507b8bac72a8b161e774b19fbd.svg
Soham De
user
sohamde
65f26e7030e67a5682a27764
Ted Klimenko
65f26e7030e67a5682a27765
Tom Hennigan
65f26e7030e67a5682a27766
Vlad Feinberg
65f26e7030e67a5682a27767
Wojciech Stokowiec
65f26e7030e67a5682a27768
Yu-hui Chen
admin_assigned
2024-03-14T08:56:28.088Z
65b98ed22f2022969fc25d3b
/avatars/7dd50758944d120acda7b7d0287c5f7a.svg
Yu-Hui Chen
user
yuhuichen1015
65f26e7030e67a5682a27769
Zafarali Ahmed
65f26e7030e67a5682a2776a
Zhitao Gong
65f26e7030e67a5682a2776b
Tris Warkentin
admin_assigned
2024-03-14T08:56:06.639Z
64d51be85e5f05485ca50751
/avatars/5802fcc5a5f1e089df41232892f8f502.svg
Tris Warkentin
user
trisfromgoogle
65f26e7030e67a5682a2776c
Ludovic Peran
admin_assigned
2024-03-14T08:55:47.728Z
60e473dcdefbf317ecd88035
/avatars/e5c069e6cfc73ea5d3d6c2a437490cdd.svg
LUDOVIC PERAN
user
LudovicPeran
65f26e7030e67a5682a2776d
Minh Giang
65f26e7030e67a5682a2776e
Clément Farabet
admin_assigned
2024-03-14T08:55:35.213Z
638a689ef560ea995b57aad4
https://cdn-avatars.huggingface.co/v1/production/uploads/1670015109688-noauth.jpeg
Clement Farabet
user
clmnt
65f26e7030e67a5682a2776f
Oriol Vinyals
65f26e7030e67a5682a27770
Jeff Dean
65f26e7030e67a5682a27771
Koray Kavukcuoglu
65f26e7030e67a5682a27772
Demis Hassabis
65f26e7030e67a5682a27773
Zoubin Ghahramani
65f26e7030e67a5682a27774
Douglas Eck
65f26e7030e67a5682a27775
Joelle Barral
65f26e7030e67a5682a27776
Fernando Pereira
65f26e7030e67a5682a27777
Eli Collins
65f26e7030e67a5682a27778
Armand Joulin
65f26e7030e67a5682a27779
Noah Fiedel
admin_assigned
2024-03-14T08:54:30.108Z
62f82ebd870a3f98bbf9e62a
/avatars/3b03299e128abf2c8ba82db704855de7.svg
Noah Fiedel
user
nfiedel
65f26e7030e67a5682a2777a
Evan Senter
admin_assigned
2024-03-14T08:54:06.474Z
62a47ec0fdd7a13aac264904
/avatars/f2ff23645203ed2399cfe8b447af437a.svg
Evan Senter
user
evansenter
65f26e7030e67a5682a2777b
Alek Andreev
admin_assigned
2024-03-14T08:53:58.001Z
65d667858ac5cf899e3b66c4
/avatars/340468ee8cd9125eceae23a9b8e536a5.svg
Alek Andreev
user
alekandreev
65f26e7030e67a5682a2777c
Kathleen Kenealy
Gemma: Open Models Based on Gemini Research and Technology
This work introduces Gemma, a family of lightweight, state-of-the art open
models built from the research and technology used to create Gemini models.
Gemma models demonstrate strong performance across academic benchmarks for
language understanding, reasoning, and safety. We release two sizes of models
(2 billion and 7 billion parameters), and provide both pretrained and
fine-tuned checkpoints. Gemma outperforms similarly sized open models on 11 out
of 18 text-based tasks, and we present comprehensive evaluations of safety and
responsibility aspects of the models, alongside a detailed description of model
development. We believe the responsible release of LLMs is critical for
improving the safety of frontier models, and for enabling the next wave of LLM
innovations.
Gemma, a family of lightweight and high-performing language models, outperforms similarly sized open models across text-based tasks and emphasizes the importance of responsible model development and safety.
lightweight state-of-the art open models Gemma Gemini models language understanding reasoning safety pretrained fine-tuned checkpoints LLMs text-based tasks blameability responsibility aspects model development