Gemini 15: Unlocking multimodal understanding across millions of tokens of context
<|reference_start|>Gemini 15: Unlocking multimodal understanding across millions of tokens of context: In this report, we introduce the Gemini 1.5 family of models, representing the next generation of highly compute-efficient multimodal models capable of recalling and reasoning over fine-grained information from millions of tokens of context, including multiple long documents and hours of video and audio. The family includes two new models: (1) an updated Gemini 1.5 Pro, which exceeds the February version on the great majority of capabilities and benchmarks; (2) Gemini 1.5 Flash, a more lightweight variant designed for efficiency with minimal regression in quality. Gemini 1.5 models achieve near-perfect recall on long-context retrieval tasks across modalities, improve the state-of-the-art in long-document QA, long-video QA and long-context ASR, and match or surpass Gemini 1.0 Ultra's state-of-the-art performance across a broad set of benchmarks. Studying the limits of Gemini 1.5's long-context ability, we find continued improvement in next-token prediction and near-perfect retrieval (>99%) up to at least 10M tokens, a generational leap over existing models such as Claude 3.0 (200k) and GPT-4 Turbo (128k). Finally, we highlight real-world use cases, such as Gemini 1.5 collaborating with professionals on completing their tasks achieving 26 to 75% time savings across 10 different job categories, as well as surprising new capabilities of large language models at the frontier; when given a grammar manual for Kalamang, a language with fewer than 200 speakers worldwide, the model learns to translate English to Kalamang at a similar level to a person who learned from the same content.<|reference_end|>
@article{gemini team2024gemini,
    title={Gemini 1.5: Unlocking multimodal understanding across millions of tokens
  of context},
    author={Gemini Team Google: Petko Georgiev, Ving Ian Lei, Ryan Burnell, Libin
  Bai, Anmol Gulati, Garrett Tanzer, Damien Vincent, Zhufeng Pan, Shibo Wang,
  Soroosh Mariooryad, Yifan Ding, Xinyang Geng, Fred Alcober, Roy Frostig, Mark
  Omernick, Lexi Walker, Cosmin Paduraru, Christina Sorokin, Andrea Tacchetti,
  Colin Gaffney, Samira Daruki, Olcan Sercinoglu, Zach Gleicher, Juliette Love,
  Paul Voigtlaender, Rohan Jain, Gabriela Surita, Kareem Mohamed, Rory Blevins,
  Junwhan Ahn, Tao Zhu, Kornraphop Kawintiranon, Orhan Firat, Yiming Gu, Yujing
  Zhang, Matthew Rahtz, Manaal Faruqui, Natalie Clay, Justin Gilmer, JD
  Co-Reyes, Ivo Penchev, Rui Zhu, Nobuyuki Morioka, Kevin Hui, Krishna
  Haridasan, Victor Campos, Mahdis Mahdieh, Mandy Guo, Samer Hassan, Kevin
  Kilgour, Arpi Vezer, Heng-Tze Cheng, Raoul de Liedekerke, Siddharth Goyal,
  Paul Barham, DJ Strouse, Seb Noury, Jonas Adler, Mukund Sundararajan, Sharad
  Vikram, Dmitry Lepikhin, Michela Paganini, Xavier Garcia, Fan Yang, Dasha
  Valter, Maja Trebacz, Kiran Vodrahalli, Chulayuth Asawaroengchai, Roman Ring,
  Norbert Kalb, Livio Baldini Soares, Siddhartha Brahma, David Steiner, Tianhe
  Yu, Fabian Mentzer, Antoine He, Lucas Gonzalez, Bibo Xu, Raphael Lopez
  Kaufman, Laurent El Shafey, Junhyuk Oh, Tom Hennigan, George van den
  Driessche, Seth Odoom, Mario Lucic, Becca Roelofs, Sid Lall, Amit Marathe,
  Betty Chan, Santiago Ontanon, Luheng He, Denis Teplyashin, Jonathan Lai, Phil
  Crone, Bogdan Damoc, Lewis Ho, Sebastian Riedel, Karel Lenc, Chih-Kuan Yeh,
  Aakanksha Chowdhery, Yang Xu, Mehran Kazemi, Ehsan Amid, Anastasia
  Petrushkina, Kevin Swersky, Ali Khodaei, Gowoon Chen, Chris Larkin, Mario
  Pinto, Geng Yan, Adria Puigdomenech Badia, Piyush Patil, Steven Hansen, Dave
  Orr, Sebastien M. R. Arnold, Jordan Grimstad, Andrew Dai, Sholto Douglas,
  Rishika Sinha, Vikas Yadav, Xi Chen, Elena Gribovskaya, Jacob Austin, Jeffrey
  Zhao, Kaushal Patel, Paul Komarek, Sophia Austin, Sebastian Borgeaud, Linda
  Friso, Abhimanyu Goyal, Ben Caine, Kris Cao, Da-Woon Chung, Matthew Lamm,
  Gabe Barth-Maron, Thais Kagohara, Kate Olszewska, Mia Chen, Kaushik
  Shivakumar, Rishabh Agarwal, Harshal Godhia, Ravi Rajwar, Javier Snaider,
  Xerxes Dotiwalla, Yuan Liu, Aditya Barua, Victor Ungureanu, Yuan Zhang,
  Bat-Orgil Batsaikhan, Mateo Wirth, James Qin, Ivo Danihelka, Tulsee Doshi,
  Martin Chadwick, Jilin Chen, Sanil Jain, Quoc Le, Arjun Kar, Madhu
  Gurumurthy, Cheng Li, Ruoxin Sang, Fangyu Liu, Lampros Lamprou, Rich Munoz,
  Nathan Lintz, Harsh Mehta, Heidi Howard, Malcolm Reynolds, Lora Aroyo, Quan
  Wang, Lorenzo Blanco, Albin Cassirer, Jordan Griffith, Dipanjan Das, Stephan
  Lee, Jakub Sygnowski, Zach Fisher, James Besley, Richard Powell, Zafarali
  Ahmed, Dominik Paulus, David Reitter, Zalan Borsos, Rishabh Joshi, Aedan
  Pope, Steven Hand, Vittorio Selo, Vihan Jain, Nikhil Sethi, Megha Goel,
  Takaki Makino, Rhys May, Zhen Yang, Johan Schalkwyk, Christina Butterfield,
  Anja Hauth, Alex Goldin, Will Hawkins, Evan Senter, Sergey Brin, Oliver
  Woodman, Marvin Ritter, Eric Noland, Minh Giang, Vijay Bolina, Lisa Lee, Tim
  Blyth, Ian Mackinnon, Machel Reid, Obaid Sarvana, David Silver, Alexander
  Chen, Lily Wang, Loren Maggiore, Oscar Chang, Nithya Attaluri, Gregory
  Thornton, Chung-Cheng Chiu, Oskar Bunyan, Nir Levine, Timothy Chung, Evgenii
  Eltyshev, Xiance Si, Timothy Lillicrap, Demetra Brady, Vaibhav Aggarwal, Boxi
  Wu, Yuanzhong Xu, Ross McIlroy, Kartikeya Badola, Paramjit Sandhu, Erica
  Moreira, Wojciech Stokowiec, Ross Hemsley, Dong Li, Alex Tudor, Pranav Shyam,
  Elahe Rahimtoroghi, Salem Haykal, Pablo Sprechmann, Xiang Zhou, Diana Mincu,
  Yujia Li, Ravi Addanki, Kalpesh Krishna, Xiao Wu, Alexandre Frechette, Matan
  Eyal, Allan Dafoe, Dave Lacey, Jay Whang, Thi Avrahami, Ye Zhang, Emanuel
  Taropa, Hanzhao Lin, Daniel Toyama, Eliza Rutherford, Motoki Sano, HyunJeong
  Choe, Alex Tomala, Chalence Safranek-Shrader, Nora Kassner, Mantas Pajarskas,
  Matt Harvey, Sean Sechrist, Meire Fortunato, Christina Lyu, Gamaleldin
  Elsayed, Chenkai Kuang, James Lottes, Eric Chu, Chao Jia, Chih-Wei Chen,
  Peter Humphreys, Kate Baumli, Connie Tao, Rajkumar Samuel, Cicero Nogueira
  dos Santos, Anders Andreassen, Nemanja Raki'cevi'c, Dominik Grewe, Aviral
  Kumar, Stephanie Winkler, Jonathan Caton, Andrew Brock, Sid Dalmia, Hannah
  Sheahan, Iain Barr, Yingjie Miao, Paul Natsev, Jacob Devlin, Feryal
  Behbahani, Flavien Prost, Yanhua Sun, Artiom Myaskovsky, Thanumalayan
  Sankaranarayana Pillai, Dan Hurt, Angeliki Lazaridou, Xi Xiong, Ce Zheng,
  Fabio Pardo, Xiaowei Li, Dan Horgan, Joe Stanton, Moran Ambar, Fei Xia,
  Alejandro Lince, Mingqiu Wang, Basil Mustafa, Albert Webson, Hyo Lee, Rohan
  Anil, Martin Wicke, Timothy Dozat, Abhishek Sinha, Enrique Piqueras, Elahe
  Dabir, Shyam Upadhyay, Anudhyan Boral, Lisa Anne Hendricks, Corey Fry, Josip
  Djolonga, Yi Su, Jake Walker, Jane Labanowski, Ronny Huang, Vedant Misra,
  Jeremy Chen, RJ Skerry-Ryan, Avi Singh, Shruti Rijhwani, Dian Yu, Alex
  Castro-Ros, Beer Changpinyo, Romina Datta, Sumit Bagri, Arnar Mar
  Hrafnkelsson, Marcello Maggioni, Daniel Zheng, Yury Sulsky, Shaobo Hou, Tom
  Le Paine, Antoine Yang, Jason Riesa, Dominika Rogozinska, Dror Marcus, Dalia
  El Badawy, Qiao Zhang, Luyu Wang, Helen Miller, Jeremy Greer, Lars Lowe Sjos,
  Azade Nova, Heiga Zen, Rahma Chaabouni, Mihaela Rosca, Jiepu Jiang, Charlie
  Chen, Ruibo Liu, Tara Sainath, Maxim Krikun, Alex Polozov, Jean-Baptiste
  Lespiau, Josh Newlan, Zeyncep Cankara, Soo Kwak, Yunhan Xu, Phil Chen, Andy
  Coenen, Clemens Meyer, Katerina Tsihlas, Ada Ma, Juraj Gottweis, Jinwei Xing,
  Chenjie Gu, Jin Miao, Christian Frank, Zeynep Cankara, Sanjay Ganapathy,
  Ishita Dasgupta, Steph Hughes-Fitt, Heng Chen, David Reid, Keran Rong,
  Hongmin Fan, Joost van Amersfoort, Vincent Zhuang, Aaron Cohen, Shixiang
  Shane Gu, Anhad Mohananey, Anastasija Ilic, Taylor Tobin, John Wieting, Anna
  Bortsova, Phoebe Thacker, Emma Wang, Emily Caveness, Justin Chiu, Eren
  Sezener, Alex Kaskasoli, Steven Baker, Katie Millican, Mohamed Elhawaty,
  Kostas Aisopos, Carl Lebsack, Nathan Byrd, Hanjun Dai, Wenhao Jia, Matthew
  Wiethoff, Elnaz Davoodi, Albert Weston, Lakshman Yagati, Arun Ahuja, Isabel
  Gao, Golan Pundak, Susan Zhang, Michael Azzam, Khe Chai Sim, Sergi Caelles,
  James Keeling, Abhanshu Sharma, Andy Swing, YaGuang Li, Chenxi Liu, Carrie
  Grimes Bostock, Yamini Bansal, Zachary Nado, Ankesh Anand, Josh Lipschultz,
  Abhijit Karmarkar, Lev Proleev, Abe Ittycheriah, Soheil Hassas Yeganeh,
  George Polovets, Aleksandra Faust, Jiao Sun, Alban Rrustemi, Pen Li, Rakesh
  Shivanna, Jeremiah Liu, Chris Welty, Federico Lebron, Anirudh Baddepudi,
  Sebastian Krause, Emilio Parisotto, Radu Soricut, Zheng Xu, Dawn Bloxwich,
  Melvin Johnson, Behnam Neyshabur, Justin Mao-Jones, Renshen Wang, Vinay
  Ramasesh, Zaheer Abbas, Arthur Guez, Constant Segal, Duc Dung Nguyen, James
  Svensson, Le Hou, Sarah York, Kieran Milan, Sophie Bridgers, Wiktor Gworek,
  Marco Tagliasacchi, James Lee-Thorp, Michael Chang, Alexey Guseynov, Ale
  Jakse Hartman, Michael Kwong, Ruizhe Zhao, Sheleem Kashem, Elizabeth Cole,
  Antoine Miech, Richard Tanburn, Mary Phuong, Filip Pavetic, Sebastien Cevey,
  Ramona Comanescu, Richard Ives, Sherry Yang, Cosmo Du, Bo Li, Zizhao Zhang,
  Mariko Iinuma, Clara Huiyi Hu, Aurko Roy, Shaan Bijwadia, Zhenkai Zhu, Danilo
  Martins, Rachel Saputro, Anita Gergely, Steven Zheng, Dawei Jia, Ioannis
  Antonoglou, Adam Sadovsky, Shane Gu, Yingying Bi, Alek Andreev, Sina
  Samangooei, Mina Khan, Tomas Kocisky, Angelos Filos, Chintu Kumar, Colton
  Bishop, Adams Yu, Sarah Hodkinson, Sid Mittal, Premal Shah, Alexandre
  Moufarek, Yong Cheng, Adam Bloniarz, Jaehoon Lee, Pedram Pejman, Paul Michel,
  Stephen Spencer, Vladimir Feinberg, Xuehan Xiong, Nikolay Savinov, Charlotte
  Smith, Siamak Shakeri, Dustin Tran, Mary Chesus, Bernd Bohnet, George Tucker,
  Tamara von Glehn, Carrie Muir, Yiran Mao, Hideto Kazawa, Ambrose Slone, Kedar
  Soparkar, Disha Shrivastava, James Cobon-Kerr, Michael Sharman, Jay
  Pavagadhi, Carlos Araya, Karolis Misiunas, Nimesh Ghelani, Michael Laskin,
  David Barker, Qiujia Li, Anton Briukhov, Neil Houlsby, Mia Glaese, Balaji
  Lakshminarayanan, Nathan Schucher, Yunhao Tang, Eli Collins, Hyeontaek Lim,
  Fangxiaoyu Feng, Adria Recasens, Guangda Lai, Alberto Magni, Nicola De Cao,
  Aditya Siddhant, Zoe Ashwood, Jordi Orbay, Mostafa Dehghani, Jenny Brennan,
  Yifan He, Kelvin Xu, Yang Gao, Carl Saroufim, James Molloy, Xinyi Wu, Seb
  Arnold, Solomon Chang, Julian Schrittwieser, Elena Buchatskaya, Soroush
  Radpour, Martin Polacek, Skye Giordano, Ankur Bapna, Simon Tokumine, Vincent
  Hellendoorn, Thibault Sottiaux, Sarah Cogan, Aliaksei Severyn, Mohammad
  Saleh, Shantanu Thakoor, Laurent Shefey, Siyuan Qiao, Meenu Gaba, Shuo-yiin
  Chang, Craig Swanson, Biao Zhang, Benjamin Lee, Paul Kishan Rubenstein, Gan
  Song, Tom Kwiatkowski, Anna Koop, Ajay Kannan, David Kao, Parker Schuh, Axel
  Stjerngren, Golnaz Ghiasi, Gena Gibson, Luke Vilnis, Ye Yuan, Felipe Tiengo
  Ferreira, Aishwarya Kamath, Ted Klimenko, Ken Franko, Kefan Xiao, Indro
  Bhattacharya, Miteyan Patel, Rui Wang, Alex Morris, Robin Strudel, Vivek
  Sharma, Peter Choy, Sayed Hadi Hashemi, Jessica Landon, Mara Finkelstein,
  Priya Jhakra, Justin Frye, Megan Barnes, Matthew Mauger, Dennis Daun, Khuslen
  Baatarsukh, Matthew Tung, Wael Farhan, Henryk Michalewski, Fabio Viola, Felix
  de Chaumont Quitry, Charline Le Lan, Tom Hudson, Qingze Wang, Felix Fischer,
  Ivy Zheng, Elspeth White, Anca Dragan, Jean-baptiste Alayrac, Eric Ni,
  Alexander Pritzel, Adam Iwanicki, Michael Isard, Anna Bulanova, Lukas Zilka,
  Ethan Dyer, Devendra Sachan, Srivatsan Srinivasan, Hannah Muckenhirn,
  Honglong Cai, Amol Mandhane, Mukarram Tariq, Jack W. Rae, Gary Wang, Kareem
  Ayoub, Nicholas FitzGerald, Yao Zhao, Woohyun Han, Chris Alberti, Dan
  Garrette, Kashyap Krishnakumar, Mai Gimenez, Anselm Levskaya, Daniel Sohn,
  Josip Matak, Inaki Iturrate, Michael B. Chang, Jackie Xiang, Yuan Cao,
  Nishant Ranka, Geoff Brown, Adrian Hutter, Vahab Mirrokni, Nanxin Chen,
  Kaisheng Yao, Zoltan Egyed, Francois Galilee, Tyler Liechty, Praveen
  Kallakuri, Evan Palmer, Sanjay Ghemawat, Jasmine Liu, David Tao, Chloe
  Thornton, Tim Green, Mimi Jasarevic, Sharon Lin, Victor Cotruta, Yi-Xuan Tan,
  Noah Fiedel, Hongkun Yu, Ed Chi, Alexander Neitz, Jens Heitkaemper, Anu
  Sinha, Denny Zhou, Yi Sun, Charbel Kaed, Brice Hulse, Swaroop Mishra, Maria
  Georgaki, Sneha Kudugunta, Clement Farabet, Izhak Shafran, Daniel Vlasic,
  Anton Tsitsulin, Rajagopal Ananthanarayanan, Alen Carin, Guolong Su, Pei Sun,
  Shashank V, Gabriel Carvajal, Josef Broder, Iulia Comsa, Alena Repina,
  William Wong, Warren Weilun Chen, Peter Hawkins, Egor Filonov, Lucia Loher,
  Christoph Hirnschall, Weiyi Wang, Jingchen Ye, Andrea Burns, Hardie Cate,
  Diana Gage Wright, Federico Piccinini, Lei Zhang, Chu-Cheng Lin, Ionel Gog,
  Yana Kulizhskaya, Ashwin Sreevatsa, Shuang Song, Luis C. Cobo, Anand Iyer,
  Chetan Tekur, Guillermo Garrido, Zhuyun Xiao, Rupert Kemp, Huaixiu Steven
  Zheng, Hui Li, Ananth Agarwal, Christel Ngani, Kati Goshvadi, Rebeca
  Santamaria-Fernandez, Wojciech Fica, Xinyun Chen, Chris Gorgolewski, Sean
  Sun, Roopal Garg, Xinyu Ye, S. M. Ali Eslami, Nan Hua, Jon Simon, Pratik
  Joshi, Yelin Kim, Ian Tenney, Sahitya Potluri, Lam Nguyen Thiet, Quan Yuan,
  Florian Luisier, Alexandra Chronopoulou, Salvatore Scellato, Praveen
  Srinivasan, Minmin Chen, Vinod Koverkathu, Valentin Dalibard, Yaming Xu,
  Brennan Saeta, Keith Anderson, Thibault Sellam, Nick Fernando, Fantine Huot,
  Junehyuk Jung, Mani Varadarajan, Michael Quinn, Amit Raul, Maigo Le, Ruslan
  Habalov, Jon Clark, Komal Jalan, Kalesha Bullard, Achintya Singhal, Thang
  Luong, Boyu Wang, Sujeevan Rajayogam, Julian Eisenschlos, Johnson Jia, Daniel
  Finchelstein, Alex Yakubovich, Daniel Balle, Michael Fink, Sameer Agarwal,
  Jing Li, Dj Dvijotham, Shalini Pal, Kai Kang, Jaclyn Konzelmann, Jennifer
  Beattie, Olivier Dousse, Diane Wu, Remi Crocker, Chen Elkind, Siddhartha
  Reddy Jonnalagadda, Jong Lee, Dan Holtmann-Rice, Krystal Kallarackal, Rosanne
  Liu, Denis Vnukov, Neera Vats, Luca Invernizzi, Mohsen Jafari, Huanjie Zhou,
  Lilly Taylor, Jennifer Prendki, Marcus Wu, Tom Eccles, Tianqi Liu, Kavya
  Kopparapu, Francoise Beaufays, Christof Angermueller, Andreea Marzoca,
  Shourya Sarcar, Hilal Dib, Jeff Stanway, Frank Perbet, Nejc Trdin, Rachel
  Sterneck, Andrey Khorlin, Dinghua Li, Xihui Wu, Sonam Goenka, David Madras,
  Sasha Goldshtein, Willi Gierke, Tong Zhou, Yaxin Liu, Yannie Liang, Anais
  White, Yunjie Li, Shreya Singh, Sanaz Bahargam, Mark Epstein, Sujoy Basu, Li
  Lao, Adnan Ozturel, Carl Crous, Alex Zhai, Han Lu, Zora Tung, Neeraj Gaur,
  Alanna Walton, Lucas Dixon, Ming Zhang, Amir Globerson, Grant Uy, Andrew
  Bolt, Olivia Wiles, Milad Nasr, Ilia Shumailov, Marco Selvi, Francesco
  Piccinno, Ricardo Aguilar, Sara McCarthy, Misha Khalman, Mrinal Shukla, Vlado
  Galic, John Carpenter, Kevin Villela, Haibin Zhang, Harry Richardson, James
  Martens, Matko Bosnjak, Shreyas Rammohan Belle, Jeff Seibert, Mahmoud
  Alnahlawi, Brian McWilliams, Sankalp Singh, Annie Louis, Wen Ding, Dan
  Popovici, Lenin Simicich, Laura Knight, Pulkit Mehta, Nishesh Gupta,
  Chongyang Shi, Saaber Fatehi, Jovana Mitrovic, Alex Grills, Joseph Pagadora,
  Dessie Petrova, Danielle Eisenbud, Zhishuai Zhang, Damion Yates, Bhavishya
  Mittal, Nilesh Tripuraneni, Yannis Assael, Thomas Brovelli, Prateek Jain,
  Mihajlo Velimirovic, Canfer Akbulut, Jiaqi Mu, Wolfgang Macherey, Ravin
  Kumar, Jun Xu, Haroon Qureshi, Gheorghe Comanici, Jeremy Wiesner, Zhitao
  Gong, Anton Ruddock, Matthias Bauer, Nick Felt, Anirudh GP, Anurag Arnab,
  Dustin Zelle, Jonas Rothfuss, Bill Rosgen, Ashish Shenoy, Bryan Seybold,
  Xinjian Li, Jayaram Mudigonda, Goker Erdogan, Jiawei Xia, Jiri Simsa, Andrea
  Michi, Yi Yao, Christopher Yew, Steven Kan, Isaac Caswell, Carey Radebaugh,
  Andre Elisseeff, Pedro Valenzuela, Kay McKinney, Kim Paterson, Albert Cui,
  Eri Latorre-Chimoto, Solomon Kim, William Zeng, Ken Durden, Priya Ponnapalli,
  Tiberiu Sosea, Christopher A. Choquette-Choo, James Manyika, Brona Robenek,
  Harsha Vashisht, Sebastien Pereira, Hoi Lam, Marko Velic, Denese
  Owusu-Afriyie, Katherine Lee, Tolga Bolukbasi, Alicia Parrish, Shawn Lu, Jane
  Park, Balaji Venkatraman, Alice Talbert, Lambert Rosique, Yuchung Cheng,
  Andrei Sozanschi, Adam Paszke, Praveen Kumar, Jessica Austin, Lu Li, Khalid
  Salama, Wooyeol Kim, Nandita Dukkipati, Anthony Baryshnikov, Christos
  Kaplanis, XiangHai Sheng, Yuri Chervonyi, Caglar Unlu, Diego de Las Casas,
  Harry Askham, Kathryn Tunyasuvunakool, Felix Gimeno, Siim Poder, Chester
  Kwak, Matt Miecnikowski, Vahab Mirrokni, Alek Dimitriev, Aaron Parisi, Dangyi
  Liu, Tomy Tsai, Toby Shevlane, Christina Kouridi, Drew Garmon, Adrian
  Goedeckemeyer, Adam R. Brown, Anitha Vijayakumar, Ali Elqursh, Sadegh
  Jazayeri, Jin Huang, Sara Mc Carthy, Jay Hoover, Lucy Kim, Sandeep Kumar, Wei
  Chen, Courtney Biles, Garrett Bingham, Evan Rosen, Lisa Wang, Qijun Tan,
  David Engel, Francesco Pongetti, Dario de Cesare, Dongseong Hwang, Lily Yu,
  Jennifer Pullman, Srini Narayanan, Kyle Levin, Siddharth Gopal, Megan Li,
  Asaf Aharoni, Trieu Trinh, Jessica Lo, Norman Casagrande, Roopali Vij, Loic
  Matthey, Bramandia Ramadhana, Austin Matthews, CJ Carey, Matthew Johnson,
  Kremena Goranova, Rohin Shah, Shereen Ashraf, Kingshuk Dasgupta, Rasmus
  Larsen, Yicheng Wang, Manish Reddy Vuyyuru, Chong Jiang, Joana Ijazi, Kazuki
  Osawa, Celine Smith, Ramya Sree Boppana, Taylan Bilal, Yuma Koizumi, Ying Xu,
  Yasemin Altun, Nir Shabat, Ben Bariach, Alex Korchemniy, Kiam Choo, Olaf
  Ronneberger, Chimezie Iwuanyanwu, Shubin Zhao, David Soergel, Cho-Jui Hsieh,
  Irene Cai, Shariq Iqbal, Martin Sundermeyer, Zhe Chen, Elie Bursztein,
  Chaitanya Malaviya, Fadi Biadsy, Prakash Shroff, Inderjit Dhillon, Tejasi
  Latkar, Chris Dyer, Hannah Forbes, Massimo Nicosia, Vitaly Nikolaev, Somer
  Greene, Marin Georgiev, Pidong Wang, Nina Martin, Hanie Sedghi, John Zhang,
  Praseem Banzal, Doug Fritz, Vikram Rao, Xuezhi Wang, Jiageng Zhang, Viorica
  Patraucean, Dayou Du, Igor Mordatch, Ivan Jurin, Lewis Liu, Ayush Dubey, Abhi
  Mohan, Janek Nowakowski, Vlad-Doru Ion, Nan Wei, Reiko Tojo, Maria Abi Raad,
  Drew A. Hudson, Vaishakh Keshava, Shubham Agrawal, Kevin Ramirez, Zhichun Wu,
  Hoang Nguyen, Ji Liu, Madhavi Sewak, Bryce Petrini, DongHyun Choi, Ivan
  Philips, Ziyue Wang, Ioana Bica, Ankush Garg, Jarek Wilkiewicz, Priyanka
  Agrawal, Xiaowei Li, Danhao Guo, Emily Xue, Naseer Shaik, Andrew Leach, Sadh
  MNM Khan, Julia Wiesinger, Sammy Jerome, Abhishek Chakladar, Alek Wenjiao
  Wang, Tina Ornduff, Folake Abu, Alireza Ghaffarkhah, Marcus Wainwright, Mario
  Cortes, Frederick Liu, Joshua Maynez, Andreas Terzis, Pouya Samangouei, Riham
  Mansour, Tomasz Kk{e}pa, Franc{c}ois-Xavier Aubet, Anton Algymr, Dan
  Banica, Agoston Weisz, Andras Orban, Alexandre Senges, Ewa Andrejczuk, Mark
  Geller, Niccolo Dal Santo, Valentin Anklin, Majd Al Merey, Martin Baeuml,
  Trevor Strohman, Junwen Bai, Slav Petrov, Yonghui Wu, Demis Hassabis, Koray
  Kavukcuoglu, Jeffrey Dean, Oriol Vinyals},
    journal={arXiv preprint arXiv:2403.05530},
    year={2024},
    archivePrefix={arXiv},
    eprint={2403.05530},
    primaryClass={cs.CL cs.AI}
}