title: Gemma 3 Technical Report
summary: We introduce Gemma 3, a multimodal addition to the Gemma family of
  lightweight open models, ranging in scale from 1 to 27 billion parameters. This
  version introduces vision understanding abilities, a wider coverage of
  languages and longer context - at least 128K tokens. We also change the
  architecture of the model to reduce the KV-cache memory that tends to explode
  with long context. This is achieved by increasing the ratio of local to global
  attention layers, and keeping the span on local attention short. The Gemma 3
  models are trained with distillation and achieve superior performance to Gemma
  2 for both pre-trained and instruction finetuned versions. In particular, our
  novel post-training recipe significantly improves the math, chat,
  instruction-following and multilingual abilities, making Gemma3-4B-IT
  competitive with Gemma2-27B-IT and Gemma3-27B-IT comparable to Gemini-1.5-Pro
  across benchmarks. We release all our models to the community.
paper_authors._id: 67e5267538e4d1444c8bb953
paper_authors.name: Gemma Team
paper_authors._id: 67e5267538e4d1444c8bb954
paper_authors.name: Aishwarya Kamath
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-03-28T16:27:50.620Z
paper_authors._id: 67c9cc34bebf5d13bf6c728a
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/j0BRlusRUUSO4fQOLRTlv.png
paper_authors.fullname: Aishwarya Kamath
paper_authors.type: user
paper_authors.user: ashkamathwork
paper_authors._id: 67e5267538e4d1444c8bb955
paper_authors.name: Johan Ferret
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:28:03.533Z
paper_authors._id: 65afb7dbdd6bdfd73cd8e609
paper_authors.avatarUrl: /avatars/b21069bc2d7ee4cc1508008e3c8ade64.svg
paper_authors.fullname: Johan Ferret
paper_authors.type: user
paper_authors.user: ferretj
paper_authors._id: 67e5267538e4d1444c8bb956
paper_authors.name: Shreya Pathak
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:28:09.908Z
paper_authors._id: 667125edfc615a6257be29bc
paper_authors.avatarUrl: /avatars/c1b191d6443b7a4ac52866a746ca5717.svg
paper_authors.fullname: Shreya Pathak
paper_authors.type: user
paper_authors.user: shreyapathak
paper_authors._id: 67e5267538e4d1444c8bb957
paper_authors.name: Nino Vieillard
paper_authors._id: 67e5267538e4d1444c8bb958
paper_authors.name: Ramona Merhej
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:28:19.392Z
paper_authors._id: 67c9bfe6ebe5592f1f05d966
paper_authors.avatarUrl: /avatars/0627e638ff2b09c28fae60d41e290235.svg
paper_authors.fullname: Ramona Merhej
paper_authors.type: user
paper_authors.user: rmerhej
paper_authors._id: 67e5267538e4d1444c8bb959
paper_authors.name: Sarah Perrin
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:28:27.391Z
paper_authors._id: 64da52ea322a5774e083e10a
paper_authors.avatarUrl: /avatars/ea8f1ec6ecec28db24438b499daa6cca.svg
paper_authors.fullname: Sarah Perrine
paper_authors.type: user
paper_authors.user: 7quidifYpaema
paper_authors._id: 67e5267538e4d1444c8bb95a
paper_authors.name: Tatiana Matejovicova
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-03-28T14:22:30.144Z
paper_authors._id: 66608363906b039ad6515b14
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/66608363906b039ad6515b14/W-pBJo9eCrLq0tRiu3CC4.jpeg
paper_authors.fullname: Tatiana Matejovicova
paper_authors.type: user
paper_authors.user: tatianama1
paper_authors._id: 67e5267538e4d1444c8bb95b
paper_authors.name: Alexandre Ramé
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:28:35.516Z
paper_authors._id: 63c94ede00104ea998de19a6
paper_authors.avatarUrl: /avatars/273959d87f0c67747588cf0700d64039.svg
paper_authors.fullname: Alexandre Rame
paper_authors.type: user
paper_authors.user: alexrame
paper_authors._id: 67e5267538e4d1444c8bb95c
paper_authors.name: Morgane Rivière
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:28:41.702Z
paper_authors._id: 66953d345d5615345518ca31
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/66953d345d5615345518ca31/rIpTxlrMxVNB9Td9fJijl.png
paper_authors.fullname: Morgane Riviere
paper_authors.type: user
paper_authors.user: morugan
paper_authors._id: 67e5267538e4d1444c8bb95d
paper_authors.name: Louis Rouillard
paper_authors._id: 67e5267538e4d1444c8bb95e
paper_authors.name: Thomas Mesnard
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:28:51.842Z
paper_authors._id: 6639adab8eb8c9c62ac3fb15
paper_authors.avatarUrl: /avatars/83133b04922143be1d8a1fb71fb2938f.svg
paper_authors.fullname: Thomas Mesnard
paper_authors.type: user
paper_authors.user: thomasmesnard
paper_authors._id: 67e5267538e4d1444c8bb95f
paper_authors.name: Geoffrey Cideron
paper_authors._id: 67e5267538e4d1444c8bb960
paper_authors.name: Jean-bastien Grill
paper_authors._id: 67e5267538e4d1444c8bb961
paper_authors.name: Sabela Ramos
paper_authors._id: 67e5267538e4d1444c8bb962
paper_authors.name: Edouard Yvinec
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:29:08.048Z
paper_authors._id: 65a044a9da292edc45176090
paper_authors.avatarUrl: /avatars/8440f76c5cf041565a766794c1f432e8.svg
paper_authors.fullname: Edouard YVINEC
paper_authors.type: user
paper_authors.user: eyvinec
paper_authors._id: 67e5267538e4d1444c8bb963
paper_authors.name: Michelle Casbon
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:29:16.305Z
paper_authors._id: 662806c1167ee93ec8e503a4
paper_authors.avatarUrl: /avatars/8dcf47f91328a38833636068686a8a5a.svg
paper_authors.fullname: Michelle Casbon
paper_authors.type: user
paper_authors.user: michellecasbon
paper_authors._id: 67e5267538e4d1444c8bb964
paper_authors.name: Etienne Pot
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:29:22.103Z
paper_authors._id: 5eed6a0e73936372ea202735
paper_authors.avatarUrl: /avatars/a2bfd7c4e403ac42737c2dd285d63a21.svg
paper_authors.fullname: Etienne POT
paper_authors.type: user
paper_authors.user: conchylicultor
paper_authors._id: 67e5267538e4d1444c8bb965
paper_authors.name: Ivo Penchev
paper_authors._id: 67e5267538e4d1444c8bb966
paper_authors.name: Gaël Liu
paper_authors._id: 67e5267538e4d1444c8bb967
paper_authors.name: Francesco Visin
paper_authors._id: 67e5267538e4d1444c8bb968
paper_authors.name: Kathleen Kenealy
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:29:48.032Z
paper_authors._id: 666b337c3fc0651814997536
paper_authors.avatarUrl: /avatars/4d6198300c286c5144794bfd2d1fa653.svg
paper_authors.fullname: Kathleen Kenealy
paper_authors.type: user
paper_authors.user: kathleenatgoogle
paper_authors._id: 67e5267538e4d1444c8bb969
paper_authors.name: Lucas Beyer
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:29:57.656Z
paper_authors._id: 642d334ff65714b4585f2de4
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/642d334ff65714b4585f2de4/gxBynq5KyoUP0VlAQD3-w.jpeg
paper_authors.fullname: Lucas Beyer
paper_authors.type: user
paper_authors.user: giffmana
paper_authors._id: 67e5267538e4d1444c8bb96a
paper_authors.name: Xiaohai Zhai
paper_authors._id: 67e5267538e4d1444c8bb96b
paper_authors.name: Anton Tsitsulin
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:30:16.674Z
paper_authors._id: 63ab8e5c8a357d5057ae659e
paper_authors.avatarUrl: /avatars/0eed94fcdb6d7c86259bc5b72b5bd41e.svg
paper_authors.fullname: Anton Tsitsulin
paper_authors.type: user
paper_authors.user: xgfs
paper_authors._id: 67e5267538e4d1444c8bb96c
paper_authors.name: Robert Busa-Fekete
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:30:24.407Z
paper_authors._id: 6744668747d61b15da8fd345
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/j3zeutPTmRfi5167_Bi47.png
paper_authors.fullname: Robert Busa-Fekete
paper_authors.type: user
paper_authors.user: busarobi
paper_authors._id: 67e5267538e4d1444c8bb96d
paper_authors.name: Alex Feng
paper_authors._id: 67e5267538e4d1444c8bb96e
paper_authors.name: Noveen Sachdeva
paper_authors._id: 67e5267538e4d1444c8bb96f
paper_authors.name: Benjamin Coleman
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:30:44.167Z
paper_authors._id: 665a131a08cba81fb74d745a
paper_authors.avatarUrl: /avatars/fc7e216b5abb556762edf4fcdbd9aad0.svg
paper_authors.fullname: Benjamin Coleman
paper_authors.type: user
paper_authors.user: BenjaminColeman305
paper_authors._id: 67e5267538e4d1444c8bb970
paper_authors.name: Yi Gao
paper_authors._id: 67e5267538e4d1444c8bb971
paper_authors.name: Basil Mustafa
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:30:51.090Z
paper_authors._id: 63cfcad6e23b90128c66685c
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/1674562206311-noauth.png
paper_authors.fullname: Basil Mustafa
paper_authors.type: user
paper_authors.user: BasilMustafa
paper_authors._id: 67e5267538e4d1444c8bb972
paper_authors.name: Iain Barr
paper_authors._id: 67e5267538e4d1444c8bb973
paper_authors.name: Emilio Parisotto
paper_authors._id: 67e5267538e4d1444c8bb974
paper_authors.name: David Tian
paper_authors._id: 67e5267538e4d1444c8bb975
paper_authors.name: Matan Eyal
paper_authors._id: 67e5267538e4d1444c8bb976
paper_authors.name: Colin Cherry
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:31:12.166Z
paper_authors._id: 6144bb22207b8aba44e8ec59
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/1631896530912-6144bb22207b8aba44e8ec59.jpeg
paper_authors.fullname: Colin Cherry
paper_authors.type: user
paper_authors.user: ColinCherry
paper_authors._id: 67e5267538e4d1444c8bb977
paper_authors.name: Jan-Thorsten Peter
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:31:20.061Z
paper_authors._id: 64cd2ae2e8df1f66dd2936cf
paper_authors.avatarUrl: /avatars/3910fa4414961e84a8bd3f844929732b.svg
paper_authors.fullname: Jan-Thorsten Peter
paper_authors.type: user
paper_authors.user: jtpeter
paper_authors._id: 67e5267538e4d1444c8bb978
paper_authors.name: Danila Sinopalnikov
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:31:27.509Z
paper_authors._id: 667a6ddc400b4b8da62488f1
paper_authors.avatarUrl: /avatars/65772bd92bbbe832eeb51298a231f57a.svg
paper_authors.fullname: Danila Sinopalnikov
paper_authors.type: user
paper_authors.user: sinopalnikov
paper_authors._id: 67e5267538e4d1444c8bb979
paper_authors.name: Surya Bhupatiraju
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:31:35.728Z
paper_authors._id: 65d7644d19bf1e60614dee6e
paper_authors.avatarUrl: /avatars/422a8d28fa9d9ff2c3ec1406352cb346.svg
paper_authors.fullname: Surya Bhupatiraju
paper_authors.type: user
paper_authors.user: suryabhupa
paper_authors._id: 67e5267538e4d1444c8bb97a
paper_authors.name: Rishabh Agarwal
paper_authors._id: 67e5267538e4d1444c8bb97b
paper_authors.name: Mehran Kazemi
paper_authors._id: 67e5267538e4d1444c8bb97c
paper_authors.name: Dan Malkin
paper_authors._id: 67e5267538e4d1444c8bb97d
paper_authors.name: Ravin Kumar
paper_authors._id: 67e5267538e4d1444c8bb97e
paper_authors.name: David Vilar
paper_authors._id: 67e5267538e4d1444c8bb97f
paper_authors.name: Idan Brusilovsky
paper_authors._id: 67e5267538e4d1444c8bb980
paper_authors.name: Jiaming Luo
paper_authors._id: 67e5267538e4d1444c8bb981
paper_authors.name: Andreas Steiner
paper_authors._id: 67e5267538e4d1444c8bb982
paper_authors.name: Abe Friesen
paper_authors._id: 67e5267538e4d1444c8bb983
paper_authors.name: Abhanshu Sharma
paper_authors._id: 67e5267538e4d1444c8bb984
paper_authors.name: Abheesht Sharma
paper_authors._id: 67e5267538e4d1444c8bb985
paper_authors.name: Adi Mayrav Gilady
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:33:14.006Z
paper_authors._id: 65ed6b3aada92a05d37a22ab
paper_authors.avatarUrl: /avatars/c4139988303da59f92729d0d2e225c9f.svg
paper_authors.fullname: Adi Mayrav Gilady
paper_authors.type: user
paper_authors.user: AdiM1234
paper_authors._id: 67e5267538e4d1444c8bb986
paper_authors.name: Adrian Goedeckemeyer
paper_authors._id: 67e5267538e4d1444c8bb987
paper_authors.name: Alaa Saade
paper_authors._id: 67e5267538e4d1444c8bb988
paper_authors.name: Alex Feng
paper_authors._id: 67e5267538e4d1444c8bb989
paper_authors.name: Alexander Kolesnikov
paper_authors._id: 67e5267538e4d1444c8bb98a
paper_authors.name: Alexei Bendebury
paper_authors._id: 67e5267538e4d1444c8bb98b
paper_authors.name: Alvin Abdagic
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:32:35.080Z
paper_authors._id: 66aaa23c08609915b3855f0b
paper_authors.avatarUrl: /avatars/6e6c105d921c41477b61af7a4a1b6495.svg
paper_authors.fullname: Alvin Abdagic
paper_authors.type: user
paper_authors.user: aabdagic
paper_authors._id: 67e5267538e4d1444c8bb98c
paper_authors.name: Amit Vadi
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:32:27.975Z
paper_authors._id: 67b7632d87214a967bbe1731
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/595EBwH8GzwGBH-nN2k4o.png
paper_authors.fullname: Amit Vadi
paper_authors.type: user
paper_authors.user: avadi
paper_authors._id: 67e5267538e4d1444c8bb98d
paper_authors.name: András György
paper_authors._id: 67e5267538e4d1444c8bb98e
paper_authors.name: André Susano Pinto
paper_authors._id: 67e5267538e4d1444c8bb98f
paper_authors.name: Anil Das
paper_authors._id: 67e5267538e4d1444c8bb990
paper_authors.name: Ankur Bapna
paper_authors._id: 67e5267538e4d1444c8bb991
paper_authors.name: Antoine Miech
paper_authors._id: 67e5267538e4d1444c8bb992
paper_authors.name: Antoine Yang
paper_authors._id: 67e5267538e4d1444c8bb993
paper_authors.name: Antonia Paterson
paper_authors._id: 67e5267538e4d1444c8bb994
paper_authors.name: Ashish Shenoy
paper_authors._id: 67e5267538e4d1444c8bb995
paper_authors.name: Ayan Chakrabarti
paper_authors._id: 67e5267538e4d1444c8bb996
paper_authors.name: Bilal Piot
paper_authors._id: 67e5267538e4d1444c8bb997
paper_authors.name: Bo Wu
paper_authors._id: 67e5267538e4d1444c8bb998
paper_authors.name: Bobak Shahriari
paper_authors._id: 67e5267538e4d1444c8bb999
paper_authors.name: Bryce Petrini
paper_authors._id: 67e5267538e4d1444c8bb99a
paper_authors.name: Charlie Chen
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:33:23.694Z
paper_authors._id: 61d3e5e1733d3a83ecd1bbc6
paper_authors.avatarUrl: /avatars/2ff141244521fd11bdd8eb147d5db127.svg
paper_authors.fullname: Charlie Chen
paper_authors.type: user
paper_authors.user: CharlieChen
paper_authors._id: 67e5267538e4d1444c8bb99b
paper_authors.name: Charline Le Lan
paper_authors._id: 67e5267538e4d1444c8bb99c
paper_authors.name: Christopher A. Choquette-Choo
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:33:45.001Z
paper_authors._id: 649c5307e89a7650158f4965
paper_authors.avatarUrl: /avatars/3c71b501db27c86ed686ae26ad1391cd.svg
paper_authors.fullname: Christopher A. Choquette-Choo
paper_authors.type: user
paper_authors.user: cchoquette
paper_authors._id: 67e5267538e4d1444c8bb99d
paper_authors.name: CJ Carey
paper_authors._id: 67e5267538e4d1444c8bb99e
paper_authors.name: Cormac Brick
paper_authors._id: 67e5267538e4d1444c8bb99f
paper_authors.name: Daniel Deutsch
paper_authors._id: 67e5267538e4d1444c8bb9a0
paper_authors.name: Danielle Eisenbud
paper_authors._id: 67e5267538e4d1444c8bb9a1
paper_authors.name: Dee Cattle
paper_authors._id: 67e5267538e4d1444c8bb9a2
paper_authors.name: Derek Cheng
paper_authors._id: 67e5267538e4d1444c8bb9a3
paper_authors.name: Dimitris Paparas
paper_authors._id: 67e5267538e4d1444c8bb9a4
paper_authors.name: Divyashree Shivakumar Sreepathihalli
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:33:55.270Z
paper_authors._id: 667a0a4f1e2351f444ffda53
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/9jC7Sxh3sv712-Rszn-9F.jpeg
paper_authors.fullname: Divyashree Shivakumar Sreepathihalli
paper_authors.type: user
paper_authors.user: Divyasreepat
paper_authors._id: 67e5267538e4d1444c8bb9a5
paper_authors.name: Doug Reid
paper_authors._id: 67e5267538e4d1444c8bb9a6
paper_authors.name: Dustin Tran
paper_authors._id: 67e5267538e4d1444c8bb9a7
paper_authors.name: Dustin Zelle
paper_authors._id: 67e5267538e4d1444c8bb9a8
paper_authors.name: Eric Noland
paper_authors._id: 67e5267538e4d1444c8bb9a9
paper_authors.name: Erwin Huizenga
paper_authors._id: 67e5267538e4d1444c8bb9aa
paper_authors.name: Eugene Kharitonov
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:36:23.292Z
paper_authors._id: 64509292fc5e5ff919b4a97d
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/64509292fc5e5ff919b4a97d/OOn5EaCXw39ePmgKptOuT.png
paper_authors.fullname: Eugene Kharitonov
paper_authors.type: user
paper_authors.user: ekharitonov
paper_authors._id: 67e5267538e4d1444c8bb9ab
paper_authors.name: Frederick Liu
paper_authors._id: 67e5267538e4d1444c8bb9ac
paper_authors.name: Gagik Amirkhanyan
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:36:14.818Z
paper_authors._id: 6454043913dba495b2dff974
paper_authors.avatarUrl: /avatars/8ff65ea746807205c243b8e1ef16fde8.svg
paper_authors.fullname: Gagik Amirkhanyan
paper_authors.type: user
paper_authors.user: Gagika
paper_authors._id: 67e5267538e4d1444c8bb9ad
paper_authors.name: Glenn Cameron
paper_authors._id: 67e5267538e4d1444c8bb9ae
paper_authors.name: Hadi Hashemi
paper_authors._id: 67e5267538e4d1444c8bb9af
paper_authors.name: Hanna Klimczak-Plucińska
paper_authors._id: 67e5267538e4d1444c8bb9b0
paper_authors.name: Harman Singh
paper_authors._id: 67e5267538e4d1444c8bb9b1
paper_authors.name: Harsh Mehta
paper_authors._id: 67e5267538e4d1444c8bb9b2
paper_authors.name: Harshal Tushar Lehri
paper_authors._id: 67e5267538e4d1444c8bb9b3
paper_authors.name: Hussein Hazimeh
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:34:31.015Z
paper_authors._id: 678bbba070768ae96ef1fb29
paper_authors.avatarUrl: /avatars/c4d8be0db958d7975172906fc1969aec.svg
paper_authors.fullname: Hussein Hazimeh
paper_authors.type: user
paper_authors.user: HusseinHzmh
paper_authors._id: 67e5267538e4d1444c8bb9b4
paper_authors.name: Ian Ballantyne
paper_authors._id: 67e5267538e4d1444c8bb9b5
paper_authors.name: Idan Szpektor
paper_authors._id: 67e5267538e4d1444c8bb9b6
paper_authors.name: Ivan Nardini
paper_authors._id: 67e5267538e4d1444c8bb9b7
paper_authors.name: Jean Pouget-Abadie
paper_authors._id: 67e5267538e4d1444c8bb9b8
paper_authors.name: Jetha Chan
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:37:33.012Z
paper_authors._id: 6670e8966d34fe6262885205
paper_authors.avatarUrl: /avatars/f5f7845a54c2bf8e418989f113272578.svg
paper_authors.fullname: Jetha Chan
paper_authors.type: user
paper_authors.user: jethac
paper_authors._id: 67e5267538e4d1444c8bb9b9
paper_authors.name: Joe Stanton
paper_authors._id: 67e5267538e4d1444c8bb9ba
paper_authors.name: John Wieting
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:34:06.809Z
paper_authors._id: 623d449d38540758f05ccfc4
paper_authors.avatarUrl: /avatars/d79808850b1a2ef5fe23e08eb6f22d57.svg
paper_authors.fullname: John Wieting
paper_authors.type: user
paper_authors.user: jwieting
paper_authors._id: 67e5267538e4d1444c8bb9bb
paper_authors.name: Jonathan Lai
paper_authors._id: 67e5267538e4d1444c8bb9bc
paper_authors.name: Jordi Orbay
paper_authors._id: 67e5267538e4d1444c8bb9bd
paper_authors.name: Joseph Fernandez
paper_authors._id: 67e5267538e4d1444c8bb9be
paper_authors.name: Josh Newlan
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:37:23.951Z
paper_authors._id: 631984ab1328b6caf9fececa
paper_authors.avatarUrl: /avatars/a31d31d7820103e45ac430dba67619af.svg
paper_authors.fullname: Josh Newlan
paper_authors.type: user
paper_authors.user: joshnewlan
paper_authors._id: 67e5267538e4d1444c8bb9bf
paper_authors.name: Ju-yeong Ji
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:38:39.549Z
paper_authors._id: 6439c159d45e8db3e28986ea
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6439c159d45e8db3e28986ea/YoSzP_3DUmev9_v5tXWds.jpeg
paper_authors.fullname: Juyeong Ji
paper_authors.type: user
paper_authors.user: bebechien
paper_authors._id: 67e5267538e4d1444c8bb9c0
paper_authors.name: Jyotinder Singh
paper_authors._id: 67e5267538e4d1444c8bb9c1
paper_authors.name: Kat Black
paper_authors._id: 67e5267538e4d1444c8bb9c2
paper_authors.name: Kathy Yu
paper_authors._id: 67e5267538e4d1444c8bb9c3
paper_authors.name: Kevin Hui
paper_authors._id: 67e5267538e4d1444c8bb9c4
paper_authors.name: Kiran Vodrahalli
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-05-28T09:01:52.968Z
paper_authors._id: 6835eea6b34ab1d58e6b8133
paper_authors.avatarUrl: /avatars/eb013082aba7cd8688e16ea56d4a213c.svg
paper_authors.fullname: Kiran Vodrahalli
paper_authors.type: user
paper_authors.user: kiranvodrahalli
paper_authors._id: 67e5267538e4d1444c8bb9c5
paper_authors.name: Klaus Greff
paper_authors._id: 67e5267538e4d1444c8bb9c6
paper_authors.name: Linhai Qiu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:40:01.734Z
paper_authors._id: 65ab594427f7d6995aad58f2
paper_authors.avatarUrl: /avatars/c417c4b99adfb554714c68e1d25f3a56.svg
paper_authors.fullname: qiulinhai
paper_authors.type: user
paper_authors.user: qiu2024
paper_authors._id: 67e5267538e4d1444c8bb9c7
paper_authors.name: Marcella Valentine
paper_authors._id: 67e5267538e4d1444c8bb9c8
paper_authors.name: Marina Coelho
paper_authors._id: 67e5267538e4d1444c8bb9c9
paper_authors.name: Marvin Ritter
paper_authors._id: 67e5267538e4d1444c8bb9ca
paper_authors.name: Matt Hoffman
paper_authors._id: 67e5267538e4d1444c8bb9cb
paper_authors.name: Matthew Watson
paper_authors._id: 67e5267538e4d1444c8bb9cc
paper_authors.name: Mayank Chaturvedi
paper_authors._id: 67e5267538e4d1444c8bb9cd
paper_authors.name: Michael Moynihan
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:33:31.912Z
paper_authors._id: 64538c820b98fb78611255ac
paper_authors.avatarUrl: /avatars/24abedf9a95c2a9c449950f20f8c22c3.svg
paper_authors.fullname: Michael Moynihan
paper_authors.type: user
paper_authors.user: michael-boonan
paper_authors._id: 67e5267538e4d1444c8bb9ce
paper_authors.name: Min Ma
paper_authors._id: 67e5267538e4d1444c8bb9cf
paper_authors.name: Nabila Babar
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:40:11.800Z
paper_authors._id: 6779de0315ed5fab589d6fb6
paper_authors.avatarUrl: /avatars/c2c86ee084ab190f80d85ec7607e961c.svg
paper_authors.fullname: Nabila Babar
paper_authors.type: user
paper_authors.user: Nababar
paper_authors._id: 67e5267538e4d1444c8bb9d0
paper_authors.name: Natasha Noy
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:39:08.225Z
paper_authors._id: 6402abc5fa1acad60069439c
paper_authors.avatarUrl: /avatars/e24e95fabddf1423eb649c3e37c29945.svg
paper_authors.fullname: Natasha Noy
paper_authors.type: user
paper_authors.user: NatashaFN
paper_authors._id: 67e5267538e4d1444c8bb9d1
paper_authors.name: Nathan Byrd
paper_authors._id: 67e5267538e4d1444c8bb9d2
paper_authors.name: Nick Roy
paper_authors._id: 67e5267538e4d1444c8bb9d3
paper_authors.name: Nikola Momchev
paper_authors._id: 67e5267538e4d1444c8bb9d4
paper_authors.name: Nilay Chauhan
paper_authors._id: 67e5267538e4d1444c8bb9d5
paper_authors.name: Noveen Sachdeva
paper_authors._id: 67e5267538e4d1444c8bb9d6
paper_authors.name: Oskar Bunyan
paper_authors._id: 67e5267538e4d1444c8bb9d7
paper_authors.name: Pankil Botarda
paper_authors._id: 67e5267538e4d1444c8bb9d8
paper_authors.name: Paul Caron
paper_authors._id: 67e5267538e4d1444c8bb9d9
paper_authors.name: Paul Kishan Rubenstein
paper_authors._id: 67e5267538e4d1444c8bb9da
paper_authors.name: Phil Culliton
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:36:48.352Z
paper_authors._id: 627a9aa0f967ef475abe8037
paper_authors.avatarUrl: /avatars/47cf94d6c015577d0a860b617c9ea2b8.svg
paper_authors.fullname: Phil Culliton
paper_authors.type: user
paper_authors.user: PhilCulliton
paper_authors._id: 67e5267538e4d1444c8bb9db
paper_authors.name: Philipp Schmid
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:36:36.617Z
paper_authors._id: 5ff5d596f244529b3ec0fb89
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/1624629516652-5ff5d596f244529b3ec0fb89.png
paper_authors.fullname: Philipp Schmid
paper_authors.type: user
paper_authors.user: philschmid
paper_authors._id: 67e5267538e4d1444c8bb9dc
paper_authors.name: Pier Giuseppe Sessa
paper_authors._id: 67e5267538e4d1444c8bb9dd
paper_authors.name: Pingmei Xu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:37:13.584Z
paper_authors._id: 64781958950ad3b14dde3bfe
paper_authors.avatarUrl: /avatars/78d8fb5a7c6a206f99e1cb4e68313187.svg
paper_authors.fullname: Pingmei Xu
paper_authors.type: user
paper_authors.user: pingmeix
paper_authors._id: 67e5267538e4d1444c8bb9de
paper_authors.name: Piotr Stanczyk
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:38:48.128Z
paper_authors._id: 67e2d0d135d3c9a9d93b6a70
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/HEMWc9pqX6qWO1pVeMvLg.png
paper_authors.fullname: Stanczyk
paper_authors.type: user
paper_authors.user: PiotrStanczyk
paper_authors._id: 67e5267538e4d1444c8bb9df
paper_authors.name: Pouya Tafti
paper_authors._id: 67e5267538e4d1444c8bb9e0
paper_authors.name: Rakesh Shivanna
paper_authors._id: 67e5267538e4d1444c8bb9e1
paper_authors.name: Renjie Wu
paper_authors._id: 67e5267538e4d1444c8bb9e2
paper_authors.name: Renke Pan
paper_authors._id: 67e5267538e4d1444c8bb9e3
paper_authors.name: Reza Rokni
paper_authors._id: 67e5267538e4d1444c8bb9e4
paper_authors.name: Rob Willoughby
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:38:05.300Z
paper_authors._id: 669583d60e08a6505b5db0a3
paper_authors.avatarUrl: /avatars/c8afae9611e1b7ac60c746d943b5734a.svg
paper_authors.fullname: Rob Willoughby
paper_authors.type: user
paper_authors.user: willougr
paper_authors._id: 67e5267538e4d1444c8bb9e5
paper_authors.name: Rohith Vallu
paper_authors._id: 67e5267538e4d1444c8bb9e6
paper_authors.name: Ryan Mullins
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-03-28T08:38:16.921Z
paper_authors._id: 65a402a53522df7a27125823
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/65a402a53522df7a27125823/tVR6lZlKmjPqi7dTZBGoS.jpeg
paper_authors.fullname: Ryan Mullins
paper_authors.type: user
paper_authors.user: RyanMullins
paper_authors._id: 67e5267538e4d1444c8bb9e7
paper_authors.name: Sammy Jerome
paper_authors._id: 67e5267538e4d1444c8bb9e8
paper_authors.name: Sara Smoot
paper_authors._id: 67e5267538e4d1444c8bb9e9
paper_authors.name: Sertan Girgin
paper_authors._id: 67e5267538e4d1444c8bb9ea
paper_authors.name: Shariq Iqbal
paper_authors._id: 67e5267538e4d1444c8bb9eb
paper_authors.name: Shashir Reddy
paper_authors._id: 67e5267538e4d1444c8bb9ec
paper_authors.name: Shruti Sheth
paper_authors._id: 67e5267538e4d1444c8bb9ed
paper_authors.name: Siim Põder
paper_authors._id: 67e5267538e4d1444c8bb9ee
paper_authors.name: Sijal Bhatnagar
paper_authors._id: 67e5267538e4d1444c8bb9ef
paper_authors.name: Sindhu Raghuram Panyam
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:39:16.300Z
paper_authors._id: 66328782bc4ab4b4505365d6
paper_authors.avatarUrl: /avatars/5a469c24dc252b4b6e5710b7385724ed.svg
paper_authors.fullname: Sindhu Raghuram Panyam
paper_authors.type: user
paper_authors.user: SindhuRaghuram97
paper_authors._id: 67e5267538e4d1444c8bb9f0
paper_authors.name: Sivan Eiger
paper_authors._id: 67e5267538e4d1444c8bb9f1
paper_authors.name: Susan Zhang
paper_authors._id: 67e5267538e4d1444c8bb9f2
paper_authors.name: Tianqi Liu
paper_authors._id: 67e5267538e4d1444c8bb9f3
paper_authors.name: Trevor Yacovone
paper_authors._id: 67e5267538e4d1444c8bb9f4
paper_authors.name: Tyler Liechty
paper_authors._id: 67e5267538e4d1444c8bb9f5
paper_authors.name: Uday Kalra
paper_authors._id: 67e5267538e4d1444c8bb9f6
paper_authors.name: Utku Evci
paper_authors._id: 67e5267538e4d1444c8bb9f7
paper_authors.name: Vedant Misra
paper_authors._id: 67e5267538e4d1444c8bb9f8
paper_authors.name: Vincent Roseberry
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:37:41.167Z
paper_authors._id: 624de3642604e14616ad0310
paper_authors.avatarUrl: /avatars/db33f1d6b0985e0b37b5d4e30aff27f5.svg
paper_authors.fullname: Vincent Roseberry
paper_authors.type: user
paper_authors.user: rosbo
paper_authors._id: 67e5267538e4d1444c8bb9f9
paper_authors.name: Vlad Feinberg
paper_authors._id: 67e5267538e4d1444c8bb9fa
paper_authors.name: Vlad Kolesnikov
paper_authors._id: 67e5267538e4d1444c8bb9fb
paper_authors.name: Woohyun Han
paper_authors._id: 67e5267538e4d1444c8bb9fc
paper_authors.name: Woosuk Kwon
paper_authors._id: 67e5267538e4d1444c8bb9fd
paper_authors.name: Xi Chen
paper_authors._id: 67e5267538e4d1444c8bb9fe
paper_authors.name: Yinlam Chow
paper_authors._id: 67e5267538e4d1444c8bb9ff
paper_authors.name: Yuvein Zhu
paper_authors._id: 67e5267538e4d1444c8bba00
paper_authors.name: Zichuan Wei
paper_authors._id: 67e5267538e4d1444c8bba01
paper_authors.name: Zoltan Egyed
paper_authors._id: 67e5267538e4d1444c8bba02
paper_authors.name: Victor Cotruta
paper_authors._id: 67e5267538e4d1444c8bba03
paper_authors.name: Minh Giang
paper_authors._id: 67e5267538e4d1444c8bba04
paper_authors.name: Phoebe Kirk
paper_authors._id: 67e5267538e4d1444c8bba05
paper_authors.name: Anand Rao
paper_authors._id: 67e5267538e4d1444c8bba06
paper_authors.name: Kat Black
paper_authors._id: 67e5267538e4d1444c8bba07
paper_authors.name: Nabila Babar
paper_authors._id: 67e5267538e4d1444c8bba08
paper_authors.name: Jessica Lo
paper_authors._id: 67e5267538e4d1444c8bba09
paper_authors.name: Erica Moreira
paper_authors._id: 67e5267538e4d1444c8bba0a
paper_authors.name: Luiz Gustavo Martins
paper_authors._id: 67e5267538e4d1444c8bba0b
paper_authors.name: Omar Sanseviero
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-03-28T16:22:42.660Z
paper_authors._id: 6032802e1f993496bc14d9e3
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6032802e1f993496bc14d9e3/w6hr-DEQot4VVkoyRIBiy.png
paper_authors.fullname: Omar Sanseviero
paper_authors.type: user
paper_authors.user: osanseviero
paper_authors._id: 67e5267538e4d1444c8bba0c
paper_authors.name: Lucas Gonzalez
paper_authors._id: 67e5267538e4d1444c8bba0d
paper_authors.name: Zach Gleicher
paper_authors._id: 67e5267538e4d1444c8bba0e
paper_authors.name: Tris Warkentin
paper_authors._id: 67e5267538e4d1444c8bba0f
paper_authors.name: Vahab Mirrokni
paper_authors._id: 67e5267538e4d1444c8bba10
paper_authors.name: Evan Senter
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:34:59.174Z
paper_authors._id: 62a47ec0fdd7a13aac264904
paper_authors.avatarUrl: /avatars/f2ff23645203ed2399cfe8b447af437a.svg
paper_authors.fullname: Evan Senter
paper_authors.type: user
paper_authors.user: evansenter
paper_authors._id: 67e5267538e4d1444c8bba11
paper_authors.name: Eli Collins
paper_authors._id: 67e5267538e4d1444c8bba12
paper_authors.name: Joelle Barral
paper_authors._id: 67e5267538e4d1444c8bba13
paper_authors.name: Zoubin Ghahramani
paper_authors._id: 67e5267538e4d1444c8bba14
paper_authors.name: Raia Hadsell
paper_authors._id: 67e5267538e4d1444c8bba15
paper_authors.name: Yossi Matias
paper_authors._id: 67e5267538e4d1444c8bba16
paper_authors.name: D. Sculley
paper_authors._id: 67e5267538e4d1444c8bba17
paper_authors.name: Slav Petrov
paper_authors._id: 67e5267538e4d1444c8bba18
paper_authors.name: Noah Fiedel
paper_authors._id: 67e5267538e4d1444c8bba19
paper_authors.name: Noam Shazeer
paper_authors._id: 67e5267538e4d1444c8bba1a
paper_authors.name: Oriol Vinyals
paper_authors._id: 67e5267538e4d1444c8bba1b
paper_authors.name: Jeff Dean
paper_authors._id: 67e5267538e4d1444c8bba1c
paper_authors.name: Demis Hassabis
paper_authors._id: 67e5267538e4d1444c8bba1d
paper_authors.name: Koray Kavukcuoglu
paper_authors._id: 67e5267538e4d1444c8bba1e
paper_authors.name: Clement Farabet
paper_authors._id: 67e5267538e4d1444c8bba1f
paper_authors.name: Elena Buchatskaya
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:39:23.676Z
paper_authors._id: 65da0ecba37e8a543ab732ca
paper_authors.avatarUrl: /avatars/90889950d8c5e0089ada6b3707104a87.svg
paper_authors.fullname: Elena Buchatskaya
paper_authors.type: user
paper_authors.user: ebuchatskaya
paper_authors._id: 67e5267538e4d1444c8bba20
paper_authors.name: Jean-Baptiste Alayrac
paper_authors._id: 67e5267538e4d1444c8bba21
paper_authors.name: Rohan Anil
paper_authors._id: 67e5267538e4d1444c8bba22
paper_authors.name: Dmitry
paper_authors._id: 67e5267538e4d1444c8bba23
paper_authors.name: Lepikhin
paper_authors._id: 67e5267538e4d1444c8bba24
paper_authors.name: Sebastian Borgeaud
paper_authors._id: 67e5267538e4d1444c8bba25
paper_authors.name: Olivier Bachem
paper_authors._id: 67e5267538e4d1444c8bba26
paper_authors.name: Armand Joulin
paper_authors._id: 67e5267538e4d1444c8bba27
paper_authors.name: Alek Andreev
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:32:10.502Z
paper_authors._id: 65d667858ac5cf899e3b66c4
paper_authors.avatarUrl: /avatars/340468ee8cd9125eceae23a9b8e536a5.svg
paper_authors.fullname: Alek Andreev
paper_authors.type: user
paper_authors.user: alekandreev
paper_authors._id: 67e5267538e4d1444c8bba28
paper_authors.name: Cassidy Hardin
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:32:00.997Z
paper_authors._id: 663a5ec5a4152b77b6cf96fd
paper_authors.avatarUrl: /avatars/a51901b21d8670e26b2ac57fd482bb63.svg
paper_authors.fullname: Cassidy Hardin
paper_authors.type: user
paper_authors.user: casshardin
paper_authors._id: 67e5267538e4d1444c8bba29
paper_authors.name: Robert Dadashi
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-28T16:31:53.064Z
paper_authors._id: 65fc7c0da57b88a765aea493
paper_authors.avatarUrl: /avatars/440f88769da1113d6158fe7e0514ead3.svg
paper_authors.fullname: Robert Dadashi
paper_authors.type: user
paper_authors.user: ddsh
paper_authors._id: 67e5267538e4d1444c8bba2a
paper_authors.name: Léonard Hussenot
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-03-28T14:22:28.133Z
paper_authors._id: 667a7b2e1764931987803b46
paper_authors.avatarUrl: /avatars/da2ee162f33c681e3d1c4d1e6d44dcbd.svg
paper_authors.fullname: Léonard Hussenot
paper_authors.type: user
paper_authors.user: leonardhussenot
paper_title: Gemma 3 Technical Report
paper_summary: We introduce Gemma 3, a multimodal addition to the Gemma family of
  lightweight open models, ranging in scale from 1 to 27 billion parameters. This
  version introduces vision understanding abilities, a wider coverage of
  languages and longer context - at least 128K tokens. We also change the
  architecture of the model to reduce the KV-cache memory that tends to explode
  with long context. This is achieved by increasing the ratio of local to global
  attention layers, and keeping the span on local attention short. The Gemma 3
  models are trained with distillation and achieve superior performance to Gemma
  2 for both pre-trained and instruction finetuned versions. In particular, our
  novel post-training recipe significantly improves the math, chat,
  instruction-following and multilingual abilities, making Gemma3-4B-IT
  competitive with Gemma2-27B-IT and Gemma3-27B-IT comparable to Gemini-1.5-Pro
  across benchmarks. We release all our models to the community.
paper_ai_summary: Gemma 3 introduces vision capabilities, broader language coverage, and extended context length, featuring an optimized architecture and post-training enhancements to outperform previous versions.
paper_ai_keywords: multimodal models vision understanding long context KV-cache memory local attention global attention model distillation pre-trained models instruction finetuned post-training recipe math ability chat ability instruction-following multilingual abilities