title: The Llama 3 Herd of Models
summary: Modern artificial intelligence (AI) systems are powered by foundation models.
  This paper presents a new set of foundation models, called Llama 3. It is a
  herd of language models that natively support multilinguality, coding,
  reasoning, and tool usage. Our largest model is a dense Transformer with 405B
  parameters and a context window of up to 128K tokens. This paper presents an
  extensive empirical evaluation of Llama 3. We find that Llama 3 delivers
  comparable quality to leading language models such as GPT-4 on a plethora of
  tasks. We publicly release Llama 3, including pre-trained and post-trained
  versions of the 405B parameter language model and our Llama Guard 3 model for
  input and output safety. The paper also presents the results of experiments in
  which we integrate image, video, and speech capabilities into Llama 3 via a
  compositional approach. We observe this approach performs competitively with
  the state-of-the-art on image, video, and speech recognition tasks. The
  resulting models are not yet being broadly released as they are still under
  development.
paper_authors._id: 66aaf835636a86cff6f5e7b3
paper_authors.name: Abhimanyu Dubey
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-08-01T15:39:47.405Z
paper_authors._id: 6376f5a98272ecd8ddacacf8
paper_authors.avatarUrl: /avatars/c57d5de9a90ec12b7f617327b1ac27fd.svg
paper_authors.fullname: Abhimanyu Dubey
paper_authors.type: user
paper_authors.user: dubeya
paper_authors._id: 66aaf835636a86cff6f5e7b4
paper_authors.name: Abhinav Jauhri
paper_authors._id: 66aaf835636a86cff6f5e7b5
paper_authors.name: Abhinav Pandey
paper_authors._id: 66aaf835636a86cff6f5e7b6
paper_authors.name: Abhishek Kadian
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-08-01T15:44:58.140Z
paper_authors._id: 62c88a674fd4a24e1523f478
paper_authors.avatarUrl: /avatars/5a21438eca713bd97f5a2c8c5cbd980a.svg
paper_authors.fullname: Abhishek Kadian
paper_authors.type: user
paper_authors.user: abhiskk
paper_authors._id: 66aaf835636a86cff6f5e7b7
paper_authors.name: Ahmad Al-Dahle
paper_authors._id: 66aaf835636a86cff6f5e7b8
paper_authors.name: Aiesha Letman
paper_authors._id: 66aaf835636a86cff6f5e7b9
paper_authors.name: Akhil Mathur
paper_authors._id: 66aaf835636a86cff6f5e7ba
paper_authors.name: Alan Schelten
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-08-01T15:46:01.561Z
paper_authors._id: 64ddf47b5a8a9efea8d6b1b7
paper_authors.avatarUrl: /avatars/0a2f1b581235942d40c9b3f37464aa64.svg
paper_authors.fullname: Alan Schelten
paper_authors.type: user
paper_authors.user: altrevr
paper_authors._id: 66aaf835636a86cff6f5e7bb
paper_authors.name: Amy Yang
paper_authors._id: 66aaf835636a86cff6f5e7bc
paper_authors.name: Angela Fan
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-08-01T15:51:05.219Z
paper_authors._id: 6089199a2b1d353b2f4c9919
paper_authors.avatarUrl: /avatars/de1bb22e89090116f5f97b5a2e061cea.svg
paper_authors.fullname: Angela Fan
paper_authors.type: user
paper_authors.user: angelafan
paper_authors._id: 66aaf835636a86cff6f5e7bd
paper_authors.name: Anirudh Goyal
paper_authors._id: 66aaf835636a86cff6f5e7be
paper_authors.name: Anthony Hartshorn
paper_authors._id: 66aaf835636a86cff6f5e7bf
paper_authors.name: Aobo Yang
paper_authors._id: 66aaf835636a86cff6f5e7c0
paper_authors.name: Archi Mitra
paper_authors._id: 66aaf835636a86cff6f5e7c1
paper_authors.name: Archie Sravankumar
paper_authors._id: 66aaf835636a86cff6f5e7c2
paper_authors.name: Artem Korenev
paper_authors._id: 66aaf835636a86cff6f5e7c3
paper_authors.name: Arthur Hinsvark
paper_authors._id: 66aaf835636a86cff6f5e7c4
paper_authors.name: Arun Rao
paper_authors._id: 66aaf835636a86cff6f5e7c5
paper_authors.name: Aston Zhang
paper_authors._id: 66aaf835636a86cff6f5e7c6
paper_authors.name: Aurelien Rodriguez
paper_authors._id: 66aaf835636a86cff6f5e7c7
paper_authors.name: Austen Gregerson
paper_authors._id: 66aaf835636a86cff6f5e7c8
paper_authors.name: Ava Spataru
paper_authors._id: 66aaf835636a86cff6f5e7c9
paper_authors.name: Baptiste Roziere
paper_authors._id: 66aaf835636a86cff6f5e7ca
paper_authors.name: Bethany Biron
paper_authors._id: 66aaf835636a86cff6f5e7cb
paper_authors.name: Binh Tang
paper_authors._id: 66aaf835636a86cff6f5e7cc
paper_authors.name: Bobbie Chern
paper_authors._id: 66aaf835636a86cff6f5e7cd
paper_authors.name: Charlotte Caucheteux
paper_authors._id: 66aaf835636a86cff6f5e7ce
paper_authors.name: Chaya Nayak
paper_authors._id: 66aaf835636a86cff6f5e7cf
paper_authors.name: Chloe Bi
paper_authors._id: 66aaf835636a86cff6f5e7d0
paper_authors.name: Chris Marra
paper_authors._id: 66aaf835636a86cff6f5e7d1
paper_authors.name: Chris McConnell
paper_authors._id: 66aaf835636a86cff6f5e7d2
paper_authors.name: Christian Keller
paper_authors._id: 66aaf835636a86cff6f5e7d3
paper_authors.name: Christophe Touret
paper_authors._id: 66aaf835636a86cff6f5e7d4
paper_authors.name: Chunyang Wu
paper_authors._id: 66aaf835636a86cff6f5e7d5
paper_authors.name: Corinne Wong
paper_authors._id: 66aaf835636a86cff6f5e7d6
paper_authors.name: Cristian Canton Ferrer
paper_authors._id: 66aaf835636a86cff6f5e7d7
paper_authors.name: Cyrus Nikolaidis
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-10-02T07:41:42.533Z
paper_authors._id: 63153d9a27d020853f67f061
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/63153d9a27d020853f67f061/qKFIxr6mmga1yktDovRwI.jpeg
paper_authors.fullname: Cyrus Nikolaidis
paper_authors.type: user
paper_authors.user: cynikolai
paper_authors._id: 66aaf835636a86cff6f5e7d8
paper_authors.name: Damien Allonsius
paper_authors._id: 66aaf835636a86cff6f5e7d9
paper_authors.name: Daniel Song
paper_authors._id: 66aaf835636a86cff6f5e7da
paper_authors.name: Danielle Pintz
paper_authors._id: 66aaf835636a86cff6f5e7db
paper_authors.name: Danny Livshits
paper_authors._id: 66aaf835636a86cff6f5e7dc
paper_authors.name: David Esiobu
paper_authors._id: 66aaf835636a86cff6f5e7dd
paper_authors.name: Dhruv Choudhary
paper_authors._id: 66aaf835636a86cff6f5e7de
paper_authors.name: Dhruv Mahajan
paper_authors._id: 66aaf835636a86cff6f5e7df
paper_authors.name: Diego Garcia-Olano
paper_authors._id: 66aaf835636a86cff6f5e7e0
paper_authors.name: Diego Perino
paper_authors._id: 66aaf835636a86cff6f5e7e1
paper_authors.name: Dieuwke Hupkes
paper_authors._id: 66aaf835636a86cff6f5e7e2
paper_authors.name: Egor Lakomkin
paper_authors._id: 66aaf835636a86cff6f5e7e3
paper_authors.name: Ehab AlBadawy
paper_authors._id: 66aaf835636a86cff6f5e7e4
paper_authors.name: Elina Lobanova
paper_authors._id: 66aaf835636a86cff6f5e7e5
paper_authors.name: Emily Dinan
paper_authors._id: 66aaf835636a86cff6f5e7e6
paper_authors.name: Eric Michael Smith
paper_authors._id: 66aaf835636a86cff6f5e7e7
paper_authors.name: Filip Radenovic
paper_authors._id: 66aaf835636a86cff6f5e7e8
paper_authors.name: Frank Zhang
paper_authors._id: 66aaf835636a86cff6f5e7e9
paper_authors.name: Gabriel Synnaeve
paper_authors._id: 66aaf835636a86cff6f5e7ea
paper_authors.name: Gabrielle Lee
paper_authors._id: 66aaf835636a86cff6f5e7eb
paper_authors.name: Georgia Lewis Anderson
paper_authors._id: 66aaf835636a86cff6f5e7ec
paper_authors.name: Graeme Nail
paper_authors._id: 66aaf835636a86cff6f5e7ed
paper_authors.name: Gregoire Mialon
paper_authors._id: 66aaf835636a86cff6f5e7ee
paper_authors.name: Guan Pang
paper_authors._id: 66aaf835636a86cff6f5e7ef
paper_authors.name: Guillem Cucurell
paper_authors._id: 66aaf835636a86cff6f5e7f0
paper_authors.name: Hailey Nguyen
paper_authors._id: 66aaf835636a86cff6f5e7f1
paper_authors.name: Hannah Korevaar
paper_authors._id: 66aaf835636a86cff6f5e7f2
paper_authors.name: Hu Xu
paper_authors._id: 66aaf835636a86cff6f5e7f3
paper_authors.name: Hugo Touvron
paper_authors._id: 66aaf835636a86cff6f5e7f4
paper_authors.name: Iliyan Zarov
paper_authors._id: 66aaf835636a86cff6f5e7f5
paper_authors.name: Imanol Arrieta Ibarra
paper_authors._id: 66aaf835636a86cff6f5e7f6
paper_authors.name: Isabel Kloumann
paper_authors._id: 66aaf835636a86cff6f5e7f7
paper_authors.name: Ishan Misra
paper_authors._id: 66aaf835636a86cff6f5e7f8
paper_authors.name: Ivan Evtimov
paper_authors._id: 66aaf835636a86cff6f5e7f9
paper_authors.name: Jade Copet
paper_authors._id: 66aaf835636a86cff6f5e7fa
paper_authors.name: Jaewon Lee
paper_authors._id: 66aaf835636a86cff6f5e7fb
paper_authors.name: Jan Geffert
paper_authors._id: 66aaf835636a86cff6f5e7fc
paper_authors.name: Jana Vranes
paper_authors._id: 66aaf835636a86cff6f5e7fd
paper_authors.name: Jason Park
paper_authors._id: 66aaf835636a86cff6f5e7fe
paper_authors.name: Jay Mahadeokar
paper_authors._id: 66aaf835636a86cff6f5e7ff
paper_authors.name: Jeet Shah
paper_authors._id: 66aaf835636a86cff6f5e800
paper_authors.name: Jelmer van der Linde
paper_authors._id: 66aaf835636a86cff6f5e801
paper_authors.name: Jennifer Billock
paper_authors._id: 66aaf835636a86cff6f5e802
paper_authors.name: Jenny Hong
paper_authors._id: 66aaf835636a86cff6f5e803
paper_authors.name: Jenya Lee
paper_authors._id: 66aaf835636a86cff6f5e804
paper_authors.name: Jeremy Fu
paper_authors._id: 66aaf835636a86cff6f5e805
paper_authors.name: Jianfeng Chi
paper_authors._id: 66aaf835636a86cff6f5e806
paper_authors.name: Jianyu Huang
paper_authors._id: 66aaf835636a86cff6f5e807
paper_authors.name: Jiawen Liu
paper_authors._id: 66aaf835636a86cff6f5e808
paper_authors.name: Jie Wang
paper_authors._id: 66aaf835636a86cff6f5e809
paper_authors.name: Jiecao Yu
paper_authors._id: 66aaf835636a86cff6f5e80a
paper_authors.name: Joanna Bitton
paper_authors._id: 66aaf835636a86cff6f5e80b
paper_authors.name: Joe Spisak
paper_authors._id: 66aaf835636a86cff6f5e80c
paper_authors.name: Jongsoo Park
paper_authors._id: 66aaf835636a86cff6f5e80d
paper_authors.name: Joseph Rocca
paper_authors._id: 66aaf835636a86cff6f5e80e
paper_authors.name: Joshua Johnstun
paper_authors._id: 66aaf835636a86cff6f5e80f
paper_authors.name: Joshua Saxe
paper_authors._id: 66aaf835636a86cff6f5e810
paper_authors.name: Junteng Jia
paper_authors._id: 66aaf835636a86cff6f5e811
paper_authors.name: Kalyan Vasuden Alwala
paper_authors._id: 66aaf835636a86cff6f5e812
paper_authors.name: Kartikeya Upasani
paper_authors._id: 66aaf835636a86cff6f5e813
paper_authors.name: Kate Plawiak
paper_authors._id: 66aaf835636a86cff6f5e814
paper_authors.name: Ke Li
paper_authors._id: 66aaf835636a86cff6f5e815
paper_authors.name: Kenneth Heafield
paper_authors._id: 66aaf835636a86cff6f5e816
paper_authors.name: Kevin Stone
paper_authors._id: 66aaf835636a86cff6f5e817
paper_authors.name: Khalid El-Arini
paper_authors._id: 66aaf835636a86cff6f5e818
paper_authors.name: Krithika Iyer
paper_authors._id: 66aaf835636a86cff6f5e819
paper_authors.name: Kshitiz Malik
paper_authors._id: 66aaf835636a86cff6f5e81a
paper_authors.name: Kuenley Chiu
paper_authors._id: 66aaf835636a86cff6f5e81b
paper_authors.name: Kunal Bhalla
paper_authors._id: 66aaf835636a86cff6f5e81c
paper_authors.name: Lauren Rantala-Yeary
paper_authors._id: 66aaf835636a86cff6f5e81d
paper_authors.name: Laurens van der Maaten
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-10-03T08:31:56.548Z
paper_authors._id: 6311629dbc152fa3e8144e1e
paper_authors.avatarUrl: /avatars/27f325beae3ee09f70fe4c341ca24790.svg
paper_authors.fullname: Laurens
paper_authors.type: user
paper_authors.user: lvdmaaten
paper_authors._id: 66aaf835636a86cff6f5e81e
paper_authors.name: Lawrence Chen
paper_authors._id: 66aaf835636a86cff6f5e81f
paper_authors.name: Liang Tan
paper_authors._id: 66aaf835636a86cff6f5e820
paper_authors.name: Liz Jenkins
paper_authors._id: 66aaf835636a86cff6f5e821
paper_authors.name: Louis Martin
paper_authors._id: 66aaf835636a86cff6f5e822
paper_authors.name: Lovish Madaan
paper_authors._id: 66aaf835636a86cff6f5e823
paper_authors.name: Lubo Malo
paper_authors._id: 66aaf835636a86cff6f5e824
paper_authors.name: Lukas Blecher
paper_authors._id: 66aaf835636a86cff6f5e825
paper_authors.name: Lukas Landzaat
paper_authors._id: 66aaf835636a86cff6f5e826
paper_authors.name: Luke de Oliveira
paper_authors._id: 66aaf835636a86cff6f5e827
paper_authors.name: Madeline Muzzi
paper_authors._id: 66aaf835636a86cff6f5e828
paper_authors.name: Mahesh Pasupuleti
paper_authors._id: 66aaf835636a86cff6f5e829
paper_authors.name: Mannat Singh
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-08-03T08:25:58.343Z
paper_authors._id: 650fece35877b1c077298b81
paper_authors.avatarUrl: /avatars/be9c948ecf9c413ad4c8aa6598d3ba86.svg
paper_authors.fullname: Mannat Singh
paper_authors.type: user
paper_authors.user: mannatsingh
paper_authors._id: 66aaf835636a86cff6f5e82a
paper_authors.name: Manohar Paluri
paper_authors._id: 66aaf835636a86cff6f5e82b
paper_authors.name: Marcin Kardas
paper_authors._id: 66aaf835636a86cff6f5e82c
paper_authors.name: Mathew Oldham
paper_authors._id: 66aaf835636a86cff6f5e82d
paper_authors.name: Mathieu Rita
paper_authors._id: 66aaf835636a86cff6f5e82e
paper_authors.name: Maya Pavlova
paper_authors._id: 66aaf835636a86cff6f5e82f
paper_authors.name: Melanie Kambadur
paper_authors._id: 66aaf835636a86cff6f5e830
paper_authors.name: Mike Lewis
paper_authors._id: 66aaf835636a86cff6f5e831
paper_authors.name: Min Si
paper_authors._id: 66aaf835636a86cff6f5e832
paper_authors.name: Mitesh Kumar Singh
paper_authors._id: 66aaf835636a86cff6f5e833
paper_authors.name: Mona Hassan
paper_authors._id: 66aaf835636a86cff6f5e834
paper_authors.name: Naman Goyal
paper_authors._id: 66aaf835636a86cff6f5e835
paper_authors.name: Narjes Torabi
paper_authors._id: 66aaf835636a86cff6f5e836
paper_authors.name: Nikolay Bashlykov
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-02-21T14:43:28.192Z
paper_authors._id: 633476edc3cb9eda9328e556
paper_authors.avatarUrl: /avatars/a127e270a606c18623fe00cd723313f6.svg
paper_authors.fullname: Nikolay B
paper_authors.type: user
paper_authors.user: bashnick
paper_authors._id: 66aaf835636a86cff6f5e837
paper_authors.name: Nikolay Bogoychev
paper_authors._id: 66aaf835636a86cff6f5e838
paper_authors.name: Niladri Chatterji
paper_authors._id: 66aaf835636a86cff6f5e839
paper_authors.name: Olivier Duchenne
paper_authors._id: 66aaf835636a86cff6f5e83a
paper_authors.name: Onur Çelebi
paper_authors._id: 66aaf835636a86cff6f5e83b
paper_authors.name: Patrick Alrassy
paper_authors._id: 66aaf835636a86cff6f5e83c
paper_authors.name: Pengchuan Zhang
paper_authors._id: 66aaf835636a86cff6f5e83d
paper_authors.name: Pengwei Li
paper_authors._id: 66aaf835636a86cff6f5e83e
paper_authors.name: Petar Vasic
paper_authors._id: 66aaf835636a86cff6f5e83f
paper_authors.name: Peter Weng
paper_authors._id: 66aaf835636a86cff6f5e840
paper_authors.name: Prajjwal Bhargava
paper_authors._id: 66aaf835636a86cff6f5e841
paper_authors.name: Pratik Dubal
paper_authors._id: 66aaf835636a86cff6f5e842
paper_authors.name: Praveen Krishnan
paper_authors._id: 66aaf835636a86cff6f5e843
paper_authors.name: Punit Singh Koura
paper_authors._id: 66aaf835636a86cff6f5e844
paper_authors.name: Puxin Xu
paper_authors._id: 66aaf835636a86cff6f5e845
paper_authors.name: Qing He
paper_authors._id: 66aaf835636a86cff6f5e846
paper_authors.name: Qingxiao Dong
paper_authors._id: 66aaf835636a86cff6f5e847
paper_authors.name: Ragavan Srinivasan
paper_authors._id: 66aaf835636a86cff6f5e848
paper_authors.name: Raj Ganapathy
paper_authors._id: 66aaf835636a86cff6f5e849
paper_authors.name: Ramon Calderer
paper_authors._id: 66aaf835636a86cff6f5e84a
paper_authors.name: Ricardo Silveira Cabral
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-02-21T14:43:25.770Z
paper_authors._id: 67b8749ffa8442592bce008e
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/ctbzupAxRhcNXDka75ANi.png
paper_authors.fullname: Ricardo Silveira Cabral
paper_authors.type: user
paper_authors.user: rscabral
paper_authors._id: 66aaf835636a86cff6f5e84b
paper_authors.name: Robert Stojnic
paper_authors._id: 66aaf835636a86cff6f5e84c
paper_authors.name: Roberta Raileanu
paper_authors._id: 66aaf835636a86cff6f5e84d
paper_authors.name: Rohit Girdhar
paper_authors._id: 66aaf835636a86cff6f5e84e
paper_authors.name: Rohit Patel
paper_authors._id: 66aaf835636a86cff6f5e84f
paper_authors.name: Romain Sauvestre
paper_authors._id: 66aaf835636a86cff6f5e850
paper_authors.name: Ronnie Polidoro
paper_authors._id: 66aaf835636a86cff6f5e851
paper_authors.name: Roshan Sumbaly
paper_authors._id: 66aaf835636a86cff6f5e852
paper_authors.name: Ross Taylor
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-02-12T09:19:26.421Z
paper_authors._id: 64b808d9ff6d81ae29870b52
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/64b808d9ff6d81ae29870b52/Oo040VGSVy-9uuzFAb-GU.jpeg
paper_authors.fullname: Ross T
paper_authors.type: user
paper_authors.user: RJT1990
paper_authors._id: 66aaf835636a86cff6f5e853
paper_authors.name: Ruan Silva
paper_authors._id: 66aaf835636a86cff6f5e854
paper_authors.name: Rui Hou
paper_authors._id: 66aaf835636a86cff6f5e855
paper_authors.name: Rui Wang
paper_authors._id: 66aaf835636a86cff6f5e856
paper_authors.name: Saghar Hosseini
paper_authors._id: 66aaf835636a86cff6f5e857
paper_authors.name: Sahana Chennabasappa
paper_authors._id: 66aaf835636a86cff6f5e858
paper_authors.name: Sanjay Singh
paper_authors._id: 66aaf835636a86cff6f5e859
paper_authors.name: Sean Bell
paper_authors._id: 66aaf835636a86cff6f5e85a
paper_authors.name: Seohyun Sonia Kim
paper_authors._id: 66aaf835636a86cff6f5e85b
paper_authors.name: Sergey Edunov
paper_authors._id: 66aaf835636a86cff6f5e85c
paper_authors.name: Shaoliang Nie
paper_authors._id: 66aaf835636a86cff6f5e85d
paper_authors.name: Sharan Narang
paper_authors._id: 66aaf835636a86cff6f5e85e
paper_authors.name: Sharath Raparthy
paper_authors._id: 66aaf835636a86cff6f5e85f
paper_authors.name: Sheng Shen
paper_authors._id: 66aaf835636a86cff6f5e860
paper_authors.name: Shengye Wan
paper_authors._id: 66aaf835636a86cff6f5e861
paper_authors.name: Shruti Bhosale
paper_authors._id: 66aaf835636a86cff6f5e862
paper_authors.name: Shun Zhang
paper_authors._id: 66aaf835636a86cff6f5e863
paper_authors.name: Simon Vandenhende
paper_authors._id: 66aaf835636a86cff6f5e864
paper_authors.name: Soumya Batra
paper_authors._id: 66aaf835636a86cff6f5e865
paper_authors.name: Spencer Whitman
paper_authors._id: 66aaf835636a86cff6f5e866
paper_authors.name: Sten Sootla
paper_authors._id: 66aaf835636a86cff6f5e867
paper_authors.name: Stephane Collot
paper_authors._id: 66aaf835636a86cff6f5e868
paper_authors.name: Suchin Gururangan
paper_authors._id: 66aaf835636a86cff6f5e869
paper_authors.name: Sydney Borodinsky
paper_authors._id: 66aaf835636a86cff6f5e86a
paper_authors.name: Tamar Herman
paper_authors._id: 66aaf835636a86cff6f5e86b
paper_authors.name: Tara Fowler
paper_authors._id: 66aaf835636a86cff6f5e86c
paper_authors.name: Tarek Sheasha
paper_authors._id: 66aaf835636a86cff6f5e86d
paper_authors.name: Thomas Georgiou
paper_authors._id: 66aaf835636a86cff6f5e86e
paper_authors.name: Thomas Scialom
paper_authors._id: 66aaf835636a86cff6f5e86f
paper_authors.name: Tobias Speckbacher
paper_authors._id: 66aaf835636a86cff6f5e870
paper_authors.name: Todor Mihaylov
paper_authors._id: 66aaf835636a86cff6f5e871
paper_authors.name: Tong Xiao
paper_authors._id: 66aaf835636a86cff6f5e872
paper_authors.name: Ujjwal Karn
paper_authors._id: 66aaf835636a86cff6f5e873
paper_authors.name: Vedanuj Goswami
paper_authors._id: 66aaf835636a86cff6f5e874
paper_authors.name: Vibhor Gupta
paper_authors._id: 66aaf835636a86cff6f5e875
paper_authors.name: Vignesh Ramanathan
paper_authors._id: 66aaf835636a86cff6f5e876
paper_authors.name: Viktor Kerkez
paper_authors._id: 66aaf835636a86cff6f5e877
paper_authors.name: Vincent Gonguet
paper_authors._id: 66aaf835636a86cff6f5e878
paper_authors.name: Virginie Do
paper_authors._id: 66aaf835636a86cff6f5e879
paper_authors.name: Vish Vogeti
paper_authors._id: 66aaf835636a86cff6f5e87a
paper_authors.name: Vladan Petrovic
paper_authors._id: 66aaf835636a86cff6f5e87b
paper_authors.name: Weiwei Chu
paper_authors._id: 66aaf835636a86cff6f5e87c
paper_authors.name: Wenhan Xiong
paper_authors._id: 66aaf835636a86cff6f5e87d
paper_authors.name: Wenyin Fu
paper_authors._id: 66aaf835636a86cff6f5e87e
paper_authors.name: Whitney Meers
paper_authors._id: 66aaf835636a86cff6f5e87f
paper_authors.name: Xavier Martinet
paper_authors._id: 66aaf835636a86cff6f5e880
paper_authors.name: Xiaodong Wang
paper_authors._id: 66aaf835636a86cff6f5e881
paper_authors.name: Xiaoqing Ellen Tan
paper_authors._id: 66aaf835636a86cff6f5e882
paper_authors.name: Xinfeng Xie
paper_authors._id: 66aaf835636a86cff6f5e883
paper_authors.name: Xuchao Jia
paper_authors._id: 66aaf835636a86cff6f5e884
paper_authors.name: Xuewei Wang
paper_authors._id: 66aaf835636a86cff6f5e885
paper_authors.name: Yaelle Goldschlag
paper_authors._id: 66aaf835636a86cff6f5e886
paper_authors.name: Yashesh Gaur
paper_authors._id: 66aaf835636a86cff6f5e887
paper_authors.name: Yasmine Babaei
paper_authors._id: 66aaf835636a86cff6f5e888
paper_authors.name: Yi Wen
paper_authors._id: 66aaf835636a86cff6f5e889
paper_authors.name: Yiwen Song
paper_authors._id: 66aaf835636a86cff6f5e88a
paper_authors.name: Yuchen Zhang
paper_authors._id: 66aaf835636a86cff6f5e88b
paper_authors.name: Yue Li
paper_authors._id: 66aaf835636a86cff6f5e88c
paper_authors.name: Yuning Mao
paper_authors._id: 66aaf835636a86cff6f5e88d
paper_authors.name: Zacharie Delpierre Coudert
paper_authors._id: 66aaf835636a86cff6f5e88e
paper_authors.name: Zheng Yan
paper_authors._id: 66aaf835636a86cff6f5e88f
paper_authors.name: Zhengxing Chen
paper_authors._id: 66aaf835636a86cff6f5e890
paper_authors.name: Zoe Papakipos
paper_authors._id: 66aaf835636a86cff6f5e891
paper_authors.name: Aaditya Singh
paper_authors._id: 66aaf835636a86cff6f5e892
paper_authors.name: Aaron Grattafiori
paper_authors._id: 66aaf835636a86cff6f5e893
paper_authors.name: Abha Jain
paper_authors._id: 66aaf835636a86cff6f5e894
paper_authors.name: Adam Kelsey
paper_authors._id: 66aaf835636a86cff6f5e895
paper_authors.name: Adam Shajnfeld
paper_authors._id: 66aaf835636a86cff6f5e896
paper_authors.name: Adithya Gangidi
paper_authors._id: 66aaf835636a86cff6f5e897
paper_authors.name: Adolfo Victoria
paper_authors._id: 66aaf835636a86cff6f5e898
paper_authors.name: Ahuva Goldstand
paper_authors._id: 66aaf835636a86cff6f5e899
paper_authors.name: Ajay Menon
paper_authors._id: 66aaf835636a86cff6f5e89a
paper_authors.name: Ajay Sharma
paper_authors._id: 66aaf835636a86cff6f5e89b
paper_authors.name: Alex Boesenberg
paper_authors._id: 66aaf835636a86cff6f5e89c
paper_authors.name: Alex Vaughan
paper_authors._id: 66aaf835636a86cff6f5e89d
paper_authors.name: Alexei Baevski
paper_authors._id: 66aaf835636a86cff6f5e89e
paper_authors.name: Allie Feinstein
paper_authors._id: 66aaf835636a86cff6f5e89f
paper_authors.name: Amanda Kallet
paper_authors._id: 66aaf835636a86cff6f5e8a0
paper_authors.name: Amit Sangani
paper_authors._id: 66aaf835636a86cff6f5e8a1
paper_authors.name: Anam Yunus
paper_authors._id: 66aaf835636a86cff6f5e8a2
paper_authors.name: Andrei Lupu
paper_authors._id: 66aaf835636a86cff6f5e8a3
paper_authors.name: Andres Alvarado
paper_authors._id: 66aaf835636a86cff6f5e8a4
paper_authors.name: Andrew Caples
paper_authors._id: 66aaf835636a86cff6f5e8a5
paper_authors.name: Andrew Gu
paper_authors._id: 66aaf835636a86cff6f5e8a6
paper_authors.name: Andrew Ho
paper_authors._id: 66aaf835636a86cff6f5e8a7
paper_authors.name: Andrew Poulton
paper_authors._id: 66aaf835636a86cff6f5e8a8
paper_authors.name: Andrew Ryan
paper_authors._id: 66aaf835636a86cff6f5e8a9
paper_authors.name: Ankit Ramchandani
paper_authors._id: 66aaf835636a86cff6f5e8aa
paper_authors.name: Annie Franco
paper_authors._id: 66aaf835636a86cff6f5e8ab
paper_authors.name: Aparajita Saraf
paper_authors._id: 66aaf835636a86cff6f5e8ac
paper_authors.name: Arkabandhu Chowdhury
paper_authors._id: 66aaf835636a86cff6f5e8ad
paper_authors.name: Ashley Gabriel
paper_authors._id: 66aaf835636a86cff6f5e8ae
paper_authors.name: Ashwin Bharambe
paper_authors._id: 66aaf835636a86cff6f5e8af
paper_authors.name: Assaf Eisenman
paper_authors._id: 66aaf835636a86cff6f5e8b0
paper_authors.name: Azadeh Yazdan
paper_authors._id: 66aaf835636a86cff6f5e8b1
paper_authors.name: Beau James
paper_authors._id: 66aaf835636a86cff6f5e8b2
paper_authors.name: Ben Maurer
paper_authors._id: 66aaf835636a86cff6f5e8b3
paper_authors.name: Benjamin Leonhardi
paper_authors._id: 66aaf835636a86cff6f5e8b4
paper_authors.name: Bernie Huang
paper_authors._id: 66aaf835636a86cff6f5e8b5
paper_authors.name: Beth Loyd
paper_authors._id: 66aaf835636a86cff6f5e8b6
paper_authors.name: Beto De Paola
paper_authors._id: 66aaf835636a86cff6f5e8b7
paper_authors.name: Bhargavi Paranjape
paper_authors._id: 66aaf835636a86cff6f5e8b8
paper_authors.name: Bing Liu
paper_authors._id: 66aaf835636a86cff6f5e8b9
paper_authors.name: Bo Wu
paper_authors._id: 66aaf835636a86cff6f5e8ba
paper_authors.name: Boyu Ni
paper_authors._id: 66aaf835636a86cff6f5e8bb
paper_authors.name: Braden Hancock
paper_authors._id: 66aaf835636a86cff6f5e8bc
paper_authors.name: Bram Wasti
paper_authors._id: 66aaf835636a86cff6f5e8bd
paper_authors.name: Brandon Spence
paper_authors._id: 66aaf835636a86cff6f5e8be
paper_authors.name: Brani Stojkovic
paper_authors._id: 66aaf835636a86cff6f5e8bf
paper_authors.name: Brian Gamido
paper_authors._id: 66aaf835636a86cff6f5e8c0
paper_authors.name: Britt Montalvo
paper_authors._id: 66aaf835636a86cff6f5e8c1
paper_authors.name: Carl Parker
paper_authors._id: 66aaf835636a86cff6f5e8c2
paper_authors.name: Carly Burton
paper_authors._id: 66aaf835636a86cff6f5e8c3
paper_authors.name: Catalina Mejia
paper_authors._id: 66aaf835636a86cff6f5e8c4
paper_authors.name: Changhan Wang
paper_authors._id: 66aaf835636a86cff6f5e8c5
paper_authors.name: Changkyu Kim
paper_authors._id: 66aaf835636a86cff6f5e8c6
paper_authors.name: Chao Zhou
paper_authors._id: 66aaf835636a86cff6f5e8c7
paper_authors.name: Chester Hu
paper_authors._id: 66aaf835636a86cff6f5e8c8
paper_authors.name: Ching-Hsiang Chu
paper_authors._id: 66aaf835636a86cff6f5e8c9
paper_authors.name: Chris Cai
paper_authors._id: 66aaf835636a86cff6f5e8ca
paper_authors.name: Chris Tindal
paper_authors._id: 66aaf835636a86cff6f5e8cb
paper_authors.name: Christoph Feichtenhofer
paper_authors._id: 66aaf835636a86cff6f5e8cc
paper_authors.name: Damon Civin
paper_authors._id: 66aaf835636a86cff6f5e8cd
paper_authors.name: Dana Beaty
paper_authors._id: 66aaf835636a86cff6f5e8ce
paper_authors.name: Daniel Kreymer
paper_authors._id: 66aaf835636a86cff6f5e8cf
paper_authors.name: Daniel Li
paper_authors._id: 66aaf835636a86cff6f5e8d0
paper_authors.name: Danny Wyatt
paper_authors._id: 66aaf835636a86cff6f5e8d1
paper_authors.name: David Adkins
paper_authors._id: 66aaf835636a86cff6f5e8d2
paper_authors.name: David Xu
paper_authors._id: 66aaf835636a86cff6f5e8d3
paper_authors.name: Davide Testuggine
paper_authors._id: 66aaf835636a86cff6f5e8d4
paper_authors.name: Delia David
paper_authors._id: 66aaf835636a86cff6f5e8d5
paper_authors.name: Devi Parikh
paper_authors._id: 66aaf835636a86cff6f5e8d6
paper_authors.name: Diana Liskovich
paper_authors._id: 66aaf835636a86cff6f5e8d7
paper_authors.name: Didem Foss
paper_authors._id: 66aaf835636a86cff6f5e8d8
paper_authors.name: Dingkang Wang
paper_authors._id: 66aaf835636a86cff6f5e8d9
paper_authors.name: Duc Le
paper_authors._id: 66aaf835636a86cff6f5e8da
paper_authors.name: Dustin Holland
paper_authors._id: 66aaf835636a86cff6f5e8db
paper_authors.name: Edward Dowling
paper_authors._id: 66aaf835636a86cff6f5e8dc
paper_authors.name: Eissa Jamil
paper_authors._id: 66aaf835636a86cff6f5e8dd
paper_authors.name: Elaine Montgomery
paper_authors._id: 66aaf835636a86cff6f5e8de
paper_authors.name: Eleonora Presani
paper_authors._id: 66aaf835636a86cff6f5e8df
paper_authors.name: Emily Hahn
paper_authors._id: 66aaf835636a86cff6f5e8e0
paper_authors.name: Emily Wood
paper_authors._id: 66aaf835636a86cff6f5e8e1
paper_authors.name: Erik Brinkman
paper_authors._id: 66aaf835636a86cff6f5e8e2
paper_authors.name: Esteban Arcaute
paper_authors._id: 66aaf835636a86cff6f5e8e3
paper_authors.name: Evan Dunbar
paper_authors._id: 66aaf835636a86cff6f5e8e4
paper_authors.name: Evan Smothers
paper_authors._id: 66aaf835636a86cff6f5e8e5
paper_authors.name: Fei Sun
paper_authors._id: 66aaf835636a86cff6f5e8e6
paper_authors.name: Felix Kreuk
paper_authors._id: 66aaf835636a86cff6f5e8e7
paper_authors.name: Feng Tian
paper_authors._id: 66aaf835636a86cff6f5e8e8
paper_authors.name: Firat Ozgenel
paper_authors._id: 66aaf835636a86cff6f5e8e9
paper_authors.name: Francesco Caggioni
paper_authors._id: 66aaf835636a86cff6f5e8ea
paper_authors.name: Francisco Guzmán
paper_authors._id: 66aaf835636a86cff6f5e8eb
paper_authors.name: Frank Kanayet
paper_authors._id: 66aaf835636a86cff6f5e8ec
paper_authors.name: Frank Seide
paper_authors._id: 66aaf835636a86cff6f5e8ed
paper_authors.name: Gabriela Medina Florez
paper_authors._id: 66aaf835636a86cff6f5e8ee
paper_authors.name: Gabriella Schwarz
paper_authors._id: 66aaf835636a86cff6f5e8ef
paper_authors.name: Gada Badeer
paper_authors._id: 66aaf835636a86cff6f5e8f0
paper_authors.name: Georgia Swee
paper_authors._id: 66aaf835636a86cff6f5e8f1
paper_authors.name: Gil Halpern
paper_authors._id: 66aaf835636a86cff6f5e8f2
paper_authors.name: Govind Thattai
paper_authors._id: 66aaf835636a86cff6f5e8f3
paper_authors.name: Grant Herman
paper_authors._id: 66aaf835636a86cff6f5e8f4
paper_authors.name: Grigory Sizov
paper_authors._id: 66aaf835636a86cff6f5e8f5
paper_authors.name: Guangyi
paper_authors._id: 66aaf835636a86cff6f5e8f6
paper_authors.name: Zhang
paper_authors._id: 66aaf835636a86cff6f5e8f7
paper_authors.name: Guna Lakshminarayanan
paper_authors._id: 66aaf835636a86cff6f5e8f8
paper_authors.name: Hamid Shojanazeri
paper_authors._id: 66aaf835636a86cff6f5e8f9
paper_authors.name: Han Zou
paper_authors._id: 66aaf835636a86cff6f5e8fa
paper_authors.name: Hannah Wang
paper_authors._id: 66aaf835636a86cff6f5e8fb
paper_authors.name: Hanwen Zha
paper_authors._id: 66aaf835636a86cff6f5e8fc
paper_authors.name: Haroun Habeeb
paper_authors._id: 66aaf835636a86cff6f5e8fd
paper_authors.name: Harrison Rudolph
paper_authors._id: 66aaf835636a86cff6f5e8fe
paper_authors.name: Helen Suk
paper_authors._id: 66aaf835636a86cff6f5e8ff
paper_authors.name: Henry Aspegren
paper_authors._id: 66aaf835636a86cff6f5e900
paper_authors.name: Hunter Goldman
paper_authors._id: 66aaf835636a86cff6f5e901
paper_authors.name: Igor Molybog
paper_authors._id: 66aaf835636a86cff6f5e902
paper_authors.name: Igor Tufanov
paper_authors._id: 66aaf835636a86cff6f5e903
paper_authors.name: Irina-Elena Veliche
paper_authors._id: 66aaf835636a86cff6f5e904
paper_authors.name: Itai Gat
paper_authors._id: 66aaf835636a86cff6f5e905
paper_authors.name: Jake Weissman
paper_authors._id: 66aaf835636a86cff6f5e906
paper_authors.name: James Geboski
paper_authors._id: 66aaf835636a86cff6f5e907
paper_authors.name: James Kohli
paper_authors._id: 66aaf835636a86cff6f5e908
paper_authors.name: Japhet Asher
paper_authors._id: 66aaf835636a86cff6f5e909
paper_authors.name: Jean-Baptiste Gaya
paper_authors._id: 66aaf835636a86cff6f5e90a
paper_authors.name: Jeff Marcus
paper_authors._id: 66aaf835636a86cff6f5e90b
paper_authors.name: Jeff Tang
paper_authors._id: 66aaf835636a86cff6f5e90c
paper_authors.name: Jennifer Chan
paper_authors._id: 66aaf835636a86cff6f5e90d
paper_authors.name: Jenny Zhen
paper_authors._id: 66aaf835636a86cff6f5e90e
paper_authors.name: Jeremy Reizenstein
paper_authors._id: 66aaf835636a86cff6f5e90f
paper_authors.name: Jeremy Teboul
paper_authors._id: 66aaf835636a86cff6f5e910
paper_authors.name: Jessica Zhong
paper_authors._id: 66aaf835636a86cff6f5e911
paper_authors.name: Jian Jin
paper_authors._id: 66aaf835636a86cff6f5e912
paper_authors.name: Jingyi Yang
paper_authors._id: 66aaf835636a86cff6f5e913
paper_authors.name: Joe Cummings
paper_authors._id: 66aaf835636a86cff6f5e914
paper_authors.name: Jon Carvill
paper_authors._id: 66aaf835636a86cff6f5e915
paper_authors.name: Jon Shepard
paper_authors._id: 66aaf835636a86cff6f5e916
paper_authors.name: Jonathan McPhie
paper_authors._id: 66aaf835636a86cff6f5e917
paper_authors.name: Jonathan Torres
paper_authors._id: 66aaf835636a86cff6f5e918
paper_authors.name: Josh Ginsburg
paper_authors._id: 66aaf835636a86cff6f5e919
paper_authors.name: Junjie Wang
paper_authors._id: 66aaf835636a86cff6f5e91a
paper_authors.name: Kai Wu
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-08-09T17:43:13.267Z
paper_authors._id: 660b40d048408366ccbe0769
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/660b40d048408366ccbe0769/MyWwlqNMHXc9gb_ygYKHs.jpeg
paper_authors.fullname: Kai Wu
paper_authors.type: user
paper_authors.user: wukaixingxp
paper_authors._id: 66aaf835636a86cff6f5e91b
paper_authors.name: Kam Hou U
paper_authors._id: 66aaf835636a86cff6f5e91c
paper_authors.name: Karan Saxena
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-03-06T09:28:25.730Z
paper_authors._id: 6601b3c3d2a378a163654efc
paper_authors.avatarUrl: /avatars/9ae79093b80997de76f1e57c134548d0.svg
paper_authors.fullname: Karan Saxena
paper_authors.type: user
paper_authors.user: weight-matrix
paper_authors._id: 66aaf835636a86cff6f5e91d
paper_authors.name: Karthik Prasad
paper_authors._id: 66aaf835636a86cff6f5e91e
paper_authors.name: Kartikay Khandelwal
paper_authors._id: 66aaf835636a86cff6f5e91f
paper_authors.name: Katayoun Zand
paper_authors._id: 66aaf835636a86cff6f5e920
paper_authors.name: Kathy Matosich
paper_authors._id: 66aaf835636a86cff6f5e921
paper_authors.name: Kaushik Veeraraghavan
paper_authors._id: 66aaf835636a86cff6f5e922
paper_authors.name: Kelly Michelena
paper_authors._id: 66aaf835636a86cff6f5e923
paper_authors.name: Keqian Li
paper_authors._id: 66aaf835636a86cff6f5e924
paper_authors.name: Kun Huang
paper_authors._id: 66aaf835636a86cff6f5e925
paper_authors.name: Kunal Chawla
paper_authors._id: 66aaf835636a86cff6f5e926
paper_authors.name: Kushal Lakhotia
paper_authors._id: 66aaf835636a86cff6f5e927
paper_authors.name: Kyle Huang
paper_authors._id: 66aaf835636a86cff6f5e928
paper_authors.name: Lailin Chen
paper_authors._id: 66aaf835636a86cff6f5e929
paper_authors.name: Lakshya Garg
paper_authors._id: 66aaf835636a86cff6f5e92a
paper_authors.name: Lavender A
paper_authors._id: 66aaf835636a86cff6f5e92b
paper_authors.name: Leandro Silva
paper_authors._id: 66aaf835636a86cff6f5e92c
paper_authors.name: Lee Bell
paper_authors._id: 66aaf835636a86cff6f5e92d
paper_authors.name: Lei Zhang
paper_authors._id: 66aaf835636a86cff6f5e92e
paper_authors.name: Liangpeng Guo
paper_authors._id: 66aaf835636a86cff6f5e92f
paper_authors.name: Licheng Yu
paper_authors._id: 66aaf835636a86cff6f5e930
paper_authors.name: Liron Moshkovich
paper_authors._id: 66aaf835636a86cff6f5e931
paper_authors.name: Luca Wehrstedt
paper_authors._id: 66aaf835636a86cff6f5e932
paper_authors.name: Madian Khabsa
paper_authors._id: 66aaf835636a86cff6f5e933
paper_authors.name: Manav Avalani
paper_authors._id: 66aaf835636a86cff6f5e934
paper_authors.name: Manish Bhatt
paper_authors._id: 66aaf835636a86cff6f5e935
paper_authors.name: Maria Tsimpoukelli
paper_authors._id: 66aaf835636a86cff6f5e936
paper_authors.name: Martynas Mankus
paper_authors._id: 66aaf835636a86cff6f5e937
paper_authors.name: Matan Hasson
paper_authors._id: 66aaf835636a86cff6f5e938
paper_authors.name: Matthew Lennie
paper_authors._id: 66aaf835636a86cff6f5e939
paper_authors.name: Matthias Reso
paper_authors._id: 66aaf835636a86cff6f5e93a
paper_authors.name: Maxim Groshev
paper_authors._id: 66aaf835636a86cff6f5e93b
paper_authors.name: Maxim Naumov
paper_authors._id: 66aaf835636a86cff6f5e93c
paper_authors.name: Maya Lathi
paper_authors._id: 66aaf835636a86cff6f5e93d
paper_authors.name: Meghan Keneally
paper_authors._id: 66aaf835636a86cff6f5e93e
paper_authors.name: Michael L. Seltzer
paper_authors._id: 66aaf835636a86cff6f5e93f
paper_authors.name: Michal Valko
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-11-15T09:46:17.269Z
paper_authors._id: 651e97156d92456bdf5ace6b
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/651e97156d92456bdf5ace6b/KKfdZGPAcWPdqycp9SulH.jpeg
paper_authors.fullname: Michal Valko
paper_authors.type: user
paper_authors.user: misovalko
paper_authors._id: 66aaf835636a86cff6f5e940
paper_authors.name: Michelle Restrepo
paper_authors._id: 66aaf835636a86cff6f5e941
paper_authors.name: Mihir Patel
paper_authors._id: 66aaf835636a86cff6f5e942
paper_authors.name: Mik Vyatskov
paper_authors._id: 66aaf835636a86cff6f5e943
paper_authors.name: Mikayel Samvelyan
paper_authors._id: 66aaf835636a86cff6f5e944
paper_authors.name: Mike Clark
paper_authors._id: 66aaf835636a86cff6f5e945
paper_authors.name: Mike Macey
paper_authors._id: 66aaf835636a86cff6f5e946
paper_authors.name: Mike Wang
paper_authors._id: 66aaf835636a86cff6f5e947
paper_authors.name: Miquel Jubert Hermoso
paper_authors._id: 66aaf835636a86cff6f5e948
paper_authors.name: Mo Metanat
paper_authors._id: 66aaf835636a86cff6f5e949
paper_authors.name: Mohammad Rastegari
paper_authors._id: 66aaf835636a86cff6f5e94a
paper_authors.name: Munish Bansal
paper_authors._id: 66aaf835636a86cff6f5e94b
paper_authors.name: Nandhini Santhanam
paper_authors._id: 66aaf835636a86cff6f5e94c
paper_authors.name: Natascha Parks
paper_authors._id: 66aaf835636a86cff6f5e94d
paper_authors.name: Natasha White
paper_authors._id: 66aaf835636a86cff6f5e94e
paper_authors.name: Navyata Bawa
paper_authors._id: 66aaf835636a86cff6f5e94f
paper_authors.name: Nayan Singhal
paper_authors._id: 66aaf835636a86cff6f5e950
paper_authors.name: Nick Egebo
paper_authors._id: 66aaf835636a86cff6f5e951
paper_authors.name: Nicolas Usunier
paper_authors._id: 66aaf835636a86cff6f5e952
paper_authors.name: Nikolay Pavlovich Laptev
paper_authors._id: 66aaf835636a86cff6f5e953
paper_authors.name: Ning Dong
paper_authors._id: 66aaf835636a86cff6f5e954
paper_authors.name: Ning Zhang
paper_authors._id: 66aaf835636a86cff6f5e955
paper_authors.name: Norman Cheng
paper_authors._id: 66aaf835636a86cff6f5e956
paper_authors.name: Oleg Chernoguz
paper_authors._id: 66aaf835636a86cff6f5e957
paper_authors.name: Olivia Hart
paper_authors._id: 66aaf835636a86cff6f5e958
paper_authors.name: Omkar Salpekar
paper_authors._id: 66aaf835636a86cff6f5e959
paper_authors.name: Ozlem Kalinli
paper_authors._id: 66aaf835636a86cff6f5e95a
paper_authors.name: Parkin Kent
paper_authors._id: 66aaf835636a86cff6f5e95b
paper_authors.name: Parth Parekh
paper_authors._id: 66aaf835636a86cff6f5e95c
paper_authors.name: Paul Saab
paper_authors._id: 66aaf835636a86cff6f5e95d
paper_authors.name: Pavan Balaji
paper_authors._id: 66aaf835636a86cff6f5e95e
paper_authors.name: Pedro Rittner
paper_authors._id: 66aaf835636a86cff6f5e95f
paper_authors.name: Philip Bontrager
paper_authors._id: 66aaf835636a86cff6f5e960
paper_authors.name: Pierre Roux
paper_authors._id: 66aaf835636a86cff6f5e961
paper_authors.name: Piotr Dollar
paper_authors._id: 66aaf835636a86cff6f5e962
paper_authors.name: Polina Zvyagina
paper_authors._id: 66aaf835636a86cff6f5e963
paper_authors.name: Prashant Ratanchandani
paper_authors._id: 66aaf835636a86cff6f5e964
paper_authors.name: Pritish Yuvraj
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-10-04T20:11:43.121Z
paper_authors._id: 65c30d162a023e7ea97c160f
paper_authors.avatarUrl: /avatars/f17eaa12dd4c4a383fb741f7ae5b9432.svg
paper_authors.fullname: Pritish Yuvraj
paper_authors.type: user
paper_authors.user: pyuvraj
paper_authors._id: 66aaf835636a86cff6f5e965
paper_authors.name: Qian Liang
paper_authors._id: 66aaf835636a86cff6f5e966
paper_authors.name: Rachad Alao
paper_authors._id: 66aaf835636a86cff6f5e967
paper_authors.name: Rachel Rodriguez
paper_authors._id: 66aaf835636a86cff6f5e968
paper_authors.name: Rafi Ayub
paper_authors._id: 66aaf835636a86cff6f5e969
paper_authors.name: Raghotham Murthy
paper_authors._id: 66aaf835636a86cff6f5e96a
paper_authors.name: Raghu Nayani
paper_authors._id: 66aaf835636a86cff6f5e96b
paper_authors.name: Rahul Mitra
paper_authors._id: 66aaf835636a86cff6f5e96c
paper_authors.name: Raymond Li
paper_authors._id: 66aaf835636a86cff6f5e96d
paper_authors.name: Rebekkah Hogan
paper_authors._id: 66aaf835636a86cff6f5e96e
paper_authors.name: Robin Battey
paper_authors._id: 66aaf835636a86cff6f5e96f
paper_authors.name: Rocky Wang
paper_authors._id: 66aaf835636a86cff6f5e970
paper_authors.name: Rohan Maheswari
paper_authors._id: 66aaf835636a86cff6f5e971
paper_authors.name: Russ Howes
paper_authors._id: 66aaf835636a86cff6f5e972
paper_authors.name: Ruty Rinott
paper_authors._id: 66aaf835636a86cff6f5e973
paper_authors.name: Sai Jayesh Bondu
paper_authors._id: 66aaf835636a86cff6f5e974
paper_authors.name: Samyak Datta
paper_authors._id: 66aaf835636a86cff6f5e975
paper_authors.name: Sara Chugh
paper_authors._id: 66aaf835636a86cff6f5e976
paper_authors.name: Sara Hunt
paper_authors._id: 66aaf835636a86cff6f5e977
paper_authors.name: Sargun Dhillon
paper_authors._id: 66aaf835636a86cff6f5e978
paper_authors.name: Sasha Sidorov
paper_authors._id: 66aaf835636a86cff6f5e979
paper_authors.name: Satadru Pan
paper_authors._id: 66aaf835636a86cff6f5e97a
paper_authors.name: Saurabh Verma
paper_authors._id: 66aaf835636a86cff6f5e97b
paper_authors.name: Seiji Yamamoto
paper_authors._id: 66aaf835636a86cff6f5e97c
paper_authors.name: Sharadh Ramaswamy
paper_authors._id: 66aaf835636a86cff6f5e97d
paper_authors.name: Shaun Lindsay
paper_authors._id: 66aaf835636a86cff6f5e97e
paper_authors.name: Shaun Lindsay
paper_authors._id: 66aaf835636a86cff6f5e97f
paper_authors.name: Sheng Feng
paper_authors._id: 66aaf835636a86cff6f5e980
paper_authors.name: Shenghao Lin
paper_authors._id: 66aaf835636a86cff6f5e981
paper_authors.name: Shengxin Cindy Zha
paper_authors._id: 66aaf835636a86cff6f5e982
paper_authors.name: Shiva Shankar
paper_authors._id: 66aaf835636a86cff6f5e983
paper_authors.name: Shuqiang Zhang
paper_authors._id: 66aaf835636a86cff6f5e984
paper_authors.name: Shuqiang Zhang
paper_authors._id: 66aaf835636a86cff6f5e985
paper_authors.name: Sinong Wang
paper_authors._id: 66aaf835636a86cff6f5e986
paper_authors.name: Sneha Agarwal
paper_authors._id: 66aaf835636a86cff6f5e987
paper_authors.name: Soji Sajuyigbe
paper_authors._id: 66aaf835636a86cff6f5e988
paper_authors.name: Soumith Chintala
paper_authors._id: 66aaf835636a86cff6f5e989
paper_authors.name: Stephanie Max
paper_authors._id: 66aaf835636a86cff6f5e98a
paper_authors.name: Stephen Chen
paper_authors._id: 66aaf835636a86cff6f5e98b
paper_authors.name: Steve Kehoe
paper_authors._id: 66aaf835636a86cff6f5e98c
paper_authors.name: Steve Satterfield
paper_authors._id: 66aaf835636a86cff6f5e98d
paper_authors.name: Sudarshan Govindaprasad
paper_authors._id: 66aaf835636a86cff6f5e98e
paper_authors.name: Sumit Gupta
paper_authors._id: 66aaf835636a86cff6f5e98f
paper_authors.name: Sungmin Cho
paper_authors._id: 66aaf835636a86cff6f5e990
paper_authors.name: Sunny Virk
paper_authors._id: 66aaf835636a86cff6f5e991
paper_authors.name: Suraj Subramanian
paper_authors._id: 66aaf835636a86cff6f5e992
paper_authors.name: Sy Choudhury
paper_authors._id: 66aaf835636a86cff6f5e993
paper_authors.name: Sydney Goldman
paper_authors._id: 66aaf835636a86cff6f5e994
paper_authors.name: Tal Remez
paper_authors._id: 66aaf835636a86cff6f5e995
paper_authors.name: Tamar Glaser
paper_authors._id: 66aaf835636a86cff6f5e996
paper_authors.name: Tamara Best
paper_authors._id: 66aaf835636a86cff6f5e997
paper_authors.name: Thilo Kohler
paper_authors._id: 66aaf835636a86cff6f5e998
paper_authors.name: Thomas Robinson
paper_authors._id: 66aaf835636a86cff6f5e999
paper_authors.name: Tianhe Li
paper_authors._id: 66aaf835636a86cff6f5e99a
paper_authors.name: Tianjun Zhang
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-08-01T07:00:20.001Z
paper_authors._id: 6374cd6b6ea8da14f8fef8dc
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6374cd6b6ea8da14f8fef8dc/l13bg0tKDjCnUw3I895QZ.png
paper_authors.fullname: Tianjun Zhang
paper_authors.type: user
paper_authors.user: tianjunz
paper_authors._id: 66aaf835636a86cff6f5e99b
paper_authors.name: Tim Matthews
paper_authors._id: 66aaf835636a86cff6f5e99c
paper_authors.name: Timothy Chou
paper_authors._id: 66aaf835636a86cff6f5e99d
paper_authors.name: Tzook Shaked
paper_authors._id: 66aaf835636a86cff6f5e99e
paper_authors.name: Varun Vontimitta
paper_authors._id: 66aaf835636a86cff6f5e99f
paper_authors.name: Victoria Ajayi
paper_authors._id: 66aaf835636a86cff6f5e9a0
paper_authors.name: Victoria Montanez
paper_authors._id: 66aaf835636a86cff6f5e9a1
paper_authors.name: Vijai Mohan
paper_authors._id: 66aaf835636a86cff6f5e9a2
paper_authors.name: Vinay Satish Kumar
paper_authors._id: 66aaf835636a86cff6f5e9a3
paper_authors.name: Vishal Mangla
paper_authors._id: 66aaf835636a86cff6f5e9a4
paper_authors.name: Vlad Ionescu
paper_authors._id: 66aaf835636a86cff6f5e9a5
paper_authors.name: Vlad Poenaru
paper_authors._id: 66aaf835636a86cff6f5e9a6
paper_authors.name: Vlad Tiberiu Mihailescu
paper_authors._id: 66aaf835636a86cff6f5e9a7
paper_authors.name: Vladimir Ivanov
paper_authors._id: 66aaf835636a86cff6f5e9a8
paper_authors.name: Wei Li
paper_authors._id: 66aaf835636a86cff6f5e9a9
paper_authors.name: Wenchen Wang
paper_authors._id: 66aaf835636a86cff6f5e9aa
paper_authors.name: Wenwen Jiang
paper_authors._id: 66aaf835636a86cff6f5e9ab
paper_authors.name: Wes Bouaziz
paper_authors._id: 66aaf835636a86cff6f5e9ac
paper_authors.name: Will Constable
paper_authors._id: 66aaf835636a86cff6f5e9ad
paper_authors.name: Xiaocheng Tang
paper_authors._id: 66aaf835636a86cff6f5e9ae
paper_authors.name: Xiaofang Wang
paper_authors._id: 66aaf835636a86cff6f5e9af
paper_authors.name: Xiaojian Wu
paper_authors._id: 66aaf835636a86cff6f5e9b0
paper_authors.name: Xiaolan Wang
paper_authors._id: 66aaf835636a86cff6f5e9b1
paper_authors.name: Xide Xia
paper_authors._id: 66aaf835636a86cff6f5e9b2
paper_authors.name: Xilun Wu
paper_authors._id: 66aaf835636a86cff6f5e9b3
paper_authors.name: Xinbo Gao
paper_authors._id: 66aaf835636a86cff6f5e9b4
paper_authors.name: Yanjun Chen
paper_authors._id: 66aaf835636a86cff6f5e9b5
paper_authors.name: Ye Hu
paper_authors._id: 66aaf835636a86cff6f5e9b6
paper_authors.name: Ye Jia
paper_authors._id: 66aaf835636a86cff6f5e9b7
paper_authors.name: Ye Qi
paper_authors._id: 66aaf835636a86cff6f5e9b8
paper_authors.name: Yenda Li
paper_authors._id: 66aaf835636a86cff6f5e9b9
paper_authors.name: Yilin Zhang
paper_authors._id: 66aaf835636a86cff6f5e9ba
paper_authors.name: Ying Zhang
paper_authors._id: 66aaf835636a86cff6f5e9bb
paper_authors.name: Yossi Adi
paper_authors._id: 66aaf835636a86cff6f5e9bc
paper_authors.name: Youngjin Nam
paper_authors._id: 66aaf835636a86cff6f5e9bd
paper_authors.name: Yu
paper_authors._id: 66aaf835636a86cff6f5e9be
paper_authors.name: Wang
paper_authors._id: 66aaf835636a86cff6f5e9bf
paper_authors.name: Yuchen Hao
paper_authors._id: 66aaf835636a86cff6f5e9c0
paper_authors.name: Yundi Qian
paper_authors._id: 66aaf835636a86cff6f5e9c1
paper_authors.name: Yuzi He
paper_authors._id: 66aaf835636a86cff6f5e9c2
paper_authors.name: Zach Rait
paper_authors._id: 66aaf835636a86cff6f5e9c3
paper_authors.name: Zachary DeVito
paper_authors._id: 66aaf835636a86cff6f5e9c4
paper_authors.name: Zef Rosnbrick
paper_authors._id: 66aaf835636a86cff6f5e9c5
paper_authors.name: Zhaoduo Wen
paper_authors._id: 66aaf835636a86cff6f5e9c6
paper_authors.name: Zhenyu Yang
paper_authors._id: 66aaf835636a86cff6f5e9c7
paper_authors.name: Zhiwei Zhao
paper_title: The Llama 3 Herd of Models
paper_summary: Modern artificial intelligence (AI) systems are powered by foundation models.
  This paper presents a new set of foundation models, called Llama 3. It is a
  herd of language models that natively support multilinguality, coding,
  reasoning, and tool usage. Our largest model is a dense Transformer with 405B
  parameters and a context window of up to 128K tokens. This paper presents an
  extensive empirical evaluation of Llama 3. We find that Llama 3 delivers
  comparable quality to leading language models such as GPT-4 on a plethora of
  tasks. We publicly release Llama 3, including pre-trained and post-trained
  versions of the 405B parameter language model and our Llama Guard 3 model for
  input and output safety. The paper also presents the results of experiments in
  which we integrate image, video, and speech capabilities into Llama 3 via a
  compositional approach. We observe this approach performs competitively with
  the state-of-the-art on image, video, and speech recognition tasks. The
  resulting models are not yet being broadly released as they are still under
  development.
paper_ai_summary: Llama 3, a multilingual and multi-modal language model with 405B parameters, achieves competitive performance across tasks including image, video, and speech recognition when integrated through a compositional approach.
paper_ai_keywords: Transformer multilinguality coding reasoning tool usage pre-trained post-trained compositional approach image recognition video recognition speech recognition