The Llama 3 Herd of Models
Modern artificial intelligence (AI) systems are powered by foundation models.
This paper presents a new set of foundation models, called Llama 3. It is a
herd of language models that natively support multilinguality, coding,
reasoning, and tool usage. Our largest model is a dense Transformer with 405B
parameters and a context window of up to 128K tokens. This paper presents an
extensive empirical evaluation of Llama 3. We find that Llama 3 delivers
comparable quality to leading language models such as GPT-4 on a plethora of
tasks. We publicly release Llama 3, including pre-trained and post-trained
versions of the 405B parameter language model and our Llama Guard 3 model for
input and output safety. The paper also presents the results of experiments in
which we integrate image, video, and speech capabilities into Llama 3 via a
compositional approach. We observe this approach performs competitively with
the state-of-the-art on image, video, and speech recognition tasks. The
resulting models are not yet being broadly released as they are still under
development.
66aaf835636a86cff6f5e7b3
Abhimanyu Dubey
admin_assigned
2024-08-01T15:39:47.405Z
6376f5a98272ecd8ddacacf8
/avatars/c57d5de9a90ec12b7f617327b1ac27fd.svg
Abhimanyu Dubey
user
dubeya
66aaf835636a86cff6f5e7b4
Abhinav Jauhri
66aaf835636a86cff6f5e7b5
Abhinav Pandey
66aaf835636a86cff6f5e7b6
Abhishek Kadian
admin_assigned
2024-08-01T15:44:58.140Z
62c88a674fd4a24e1523f478
/avatars/5a21438eca713bd97f5a2c8c5cbd980a.svg
Abhishek Kadian
user
abhiskk
66aaf835636a86cff6f5e7b7
Ahmad Al-Dahle
66aaf835636a86cff6f5e7b8
Aiesha Letman
66aaf835636a86cff6f5e7b9
Akhil Mathur
66aaf835636a86cff6f5e7ba
Alan Schelten
admin_assigned
2024-08-01T15:46:01.561Z
64ddf47b5a8a9efea8d6b1b7
/avatars/0a2f1b581235942d40c9b3f37464aa64.svg
Alan Schelten
user
altrevr
66aaf835636a86cff6f5e7bb
Amy Yang
66aaf835636a86cff6f5e7bc
Angela Fan
admin_assigned
2024-08-01T15:51:05.219Z
6089199a2b1d353b2f4c9919
/avatars/de1bb22e89090116f5f97b5a2e061cea.svg
Angela Fan
user
angelafan
66aaf835636a86cff6f5e7bd
Anirudh Goyal
66aaf835636a86cff6f5e7be
Anthony Hartshorn
66aaf835636a86cff6f5e7bf
Aobo Yang
66aaf835636a86cff6f5e7c0
Archi Mitra
66aaf835636a86cff6f5e7c1
Archie Sravankumar
66aaf835636a86cff6f5e7c2
Artem Korenev
66aaf835636a86cff6f5e7c3
Arthur Hinsvark
66aaf835636a86cff6f5e7c4
Arun Rao
66aaf835636a86cff6f5e7c5
Aston Zhang
66aaf835636a86cff6f5e7c6
Aurelien Rodriguez
66aaf835636a86cff6f5e7c7
Austen Gregerson
66aaf835636a86cff6f5e7c8
Ava Spataru
66aaf835636a86cff6f5e7c9
Baptiste Roziere
66aaf835636a86cff6f5e7ca
Bethany Biron
66aaf835636a86cff6f5e7cb
Binh Tang
66aaf835636a86cff6f5e7cc
Bobbie Chern
66aaf835636a86cff6f5e7cd
Charlotte Caucheteux
66aaf835636a86cff6f5e7ce
Chaya Nayak
66aaf835636a86cff6f5e7cf
Chloe Bi
66aaf835636a86cff6f5e7d0
Chris Marra
66aaf835636a86cff6f5e7d1
Chris McConnell
66aaf835636a86cff6f5e7d2
Christian Keller
66aaf835636a86cff6f5e7d3
Christophe Touret
66aaf835636a86cff6f5e7d4
Chunyang Wu
66aaf835636a86cff6f5e7d5
Corinne Wong
66aaf835636a86cff6f5e7d6
Cristian Canton Ferrer
66aaf835636a86cff6f5e7d7
Cyrus Nikolaidis
claimed_verified
2024-10-02T07:41:42.533Z
63153d9a27d020853f67f061
https://cdn-avatars.huggingface.co/v1/production/uploads/63153d9a27d020853f67f061/qKFIxr6mmga1yktDovRwI.jpeg
Cyrus Nikolaidis
user
cynikolai
66aaf835636a86cff6f5e7d8
Damien Allonsius
66aaf835636a86cff6f5e7d9
Daniel Song
66aaf835636a86cff6f5e7da
Danielle Pintz
66aaf835636a86cff6f5e7db
Danny Livshits
66aaf835636a86cff6f5e7dc
David Esiobu
66aaf835636a86cff6f5e7dd
Dhruv Choudhary
66aaf835636a86cff6f5e7de
Dhruv Mahajan
66aaf835636a86cff6f5e7df
Diego Garcia-Olano
66aaf835636a86cff6f5e7e0
Diego Perino
66aaf835636a86cff6f5e7e1
Dieuwke Hupkes
66aaf835636a86cff6f5e7e2
Egor Lakomkin
66aaf835636a86cff6f5e7e3
Ehab AlBadawy
66aaf835636a86cff6f5e7e4
Elina Lobanova
66aaf835636a86cff6f5e7e5
Emily Dinan
66aaf835636a86cff6f5e7e6
Eric Michael Smith
66aaf835636a86cff6f5e7e7
Filip Radenovic
66aaf835636a86cff6f5e7e8
Frank Zhang
66aaf835636a86cff6f5e7e9
Gabriel Synnaeve
66aaf835636a86cff6f5e7ea
Gabrielle Lee
66aaf835636a86cff6f5e7eb
Georgia Lewis Anderson
66aaf835636a86cff6f5e7ec
Graeme Nail
66aaf835636a86cff6f5e7ed
Gregoire Mialon
66aaf835636a86cff6f5e7ee
Guan Pang
66aaf835636a86cff6f5e7ef
Guillem Cucurell
66aaf835636a86cff6f5e7f0
Hailey Nguyen
66aaf835636a86cff6f5e7f1
Hannah Korevaar
66aaf835636a86cff6f5e7f2
Hu Xu
66aaf835636a86cff6f5e7f3
Hugo Touvron
66aaf835636a86cff6f5e7f4
Iliyan Zarov
66aaf835636a86cff6f5e7f5
Imanol Arrieta Ibarra
66aaf835636a86cff6f5e7f6
Isabel Kloumann
66aaf835636a86cff6f5e7f7
Ishan Misra
66aaf835636a86cff6f5e7f8
Ivan Evtimov
66aaf835636a86cff6f5e7f9
Jade Copet
66aaf835636a86cff6f5e7fa
Jaewon Lee
66aaf835636a86cff6f5e7fb
Jan Geffert
66aaf835636a86cff6f5e7fc
Jana Vranes
66aaf835636a86cff6f5e7fd
Jason Park
66aaf835636a86cff6f5e7fe
Jay Mahadeokar
66aaf835636a86cff6f5e7ff
Jeet Shah
66aaf835636a86cff6f5e800
Jelmer van der Linde
66aaf835636a86cff6f5e801
Jennifer Billock
66aaf835636a86cff6f5e802
Jenny Hong
66aaf835636a86cff6f5e803
Jenya Lee
66aaf835636a86cff6f5e804
Jeremy Fu
66aaf835636a86cff6f5e805
Jianfeng Chi
66aaf835636a86cff6f5e806
Jianyu Huang
66aaf835636a86cff6f5e807
Jiawen Liu
66aaf835636a86cff6f5e808
Jie Wang
66aaf835636a86cff6f5e809
Jiecao Yu
66aaf835636a86cff6f5e80a
Joanna Bitton
66aaf835636a86cff6f5e80b
Joe Spisak
66aaf835636a86cff6f5e80c
Jongsoo Park
66aaf835636a86cff6f5e80d
Joseph Rocca
66aaf835636a86cff6f5e80e
Joshua Johnstun
66aaf835636a86cff6f5e80f
Joshua Saxe
66aaf835636a86cff6f5e810
Junteng Jia
66aaf835636a86cff6f5e811
Kalyan Vasuden Alwala
66aaf835636a86cff6f5e812
Kartikeya Upasani
66aaf835636a86cff6f5e813
Kate Plawiak
66aaf835636a86cff6f5e814
Ke Li
66aaf835636a86cff6f5e815
Kenneth Heafield
66aaf835636a86cff6f5e816
Kevin Stone
66aaf835636a86cff6f5e817
Khalid El-Arini
66aaf835636a86cff6f5e818
Krithika Iyer
66aaf835636a86cff6f5e819
Kshitiz Malik
66aaf835636a86cff6f5e81a
Kuenley Chiu
66aaf835636a86cff6f5e81b
Kunal Bhalla
66aaf835636a86cff6f5e81c
Lauren Rantala-Yeary
66aaf835636a86cff6f5e81d
Laurens van der Maaten
claimed_verified
2024-10-03T08:31:56.548Z
6311629dbc152fa3e8144e1e
/avatars/27f325beae3ee09f70fe4c341ca24790.svg
Laurens
user
lvdmaaten
66aaf835636a86cff6f5e81e
Lawrence Chen
66aaf835636a86cff6f5e81f
Liang Tan
66aaf835636a86cff6f5e820
Liz Jenkins
66aaf835636a86cff6f5e821
Louis Martin
66aaf835636a86cff6f5e822
Lovish Madaan
66aaf835636a86cff6f5e823
Lubo Malo
66aaf835636a86cff6f5e824
Lukas Blecher
66aaf835636a86cff6f5e825
Lukas Landzaat
66aaf835636a86cff6f5e826
Luke de Oliveira
66aaf835636a86cff6f5e827
Madeline Muzzi
66aaf835636a86cff6f5e828
Mahesh Pasupuleti
66aaf835636a86cff6f5e829
Mannat Singh
claimed_verified
2024-08-03T08:25:58.343Z
650fece35877b1c077298b81
/avatars/be9c948ecf9c413ad4c8aa6598d3ba86.svg
Mannat Singh
user
mannatsingh
66aaf835636a86cff6f5e82a
Manohar Paluri
66aaf835636a86cff6f5e82b
Marcin Kardas
66aaf835636a86cff6f5e82c
Mathew Oldham
66aaf835636a86cff6f5e82d
Mathieu Rita
66aaf835636a86cff6f5e82e
Maya Pavlova
66aaf835636a86cff6f5e82f
Melanie Kambadur
66aaf835636a86cff6f5e830
Mike Lewis
66aaf835636a86cff6f5e831
Min Si
66aaf835636a86cff6f5e832
Mitesh Kumar Singh
66aaf835636a86cff6f5e833
Mona Hassan
66aaf835636a86cff6f5e834
Naman Goyal
66aaf835636a86cff6f5e835
Narjes Torabi
66aaf835636a86cff6f5e836
Nikolay Bashlykov
claimed_verified
2025-02-21T14:43:28.192Z
633476edc3cb9eda9328e556
/avatars/a127e270a606c18623fe00cd723313f6.svg
Nikolay B
user
bashnick
66aaf835636a86cff6f5e837
Nikolay Bogoychev
66aaf835636a86cff6f5e838
Niladri Chatterji
66aaf835636a86cff6f5e839
Olivier Duchenne
66aaf835636a86cff6f5e83a
Onur Çelebi
66aaf835636a86cff6f5e83b
Patrick Alrassy
66aaf835636a86cff6f5e83c
Pengchuan Zhang
66aaf835636a86cff6f5e83d
Pengwei Li
66aaf835636a86cff6f5e83e
Petar Vasic
66aaf835636a86cff6f5e83f
Peter Weng
66aaf835636a86cff6f5e840
Prajjwal Bhargava
66aaf835636a86cff6f5e841
Pratik Dubal
66aaf835636a86cff6f5e842
Praveen Krishnan
66aaf835636a86cff6f5e843
Punit Singh Koura
66aaf835636a86cff6f5e844
Puxin Xu
66aaf835636a86cff6f5e845
Qing He
66aaf835636a86cff6f5e846
Qingxiao Dong
66aaf835636a86cff6f5e847
Ragavan Srinivasan
66aaf835636a86cff6f5e848
Raj Ganapathy
66aaf835636a86cff6f5e849
Ramon Calderer
66aaf835636a86cff6f5e84a
Ricardo Silveira Cabral
claimed_verified
2025-02-21T14:43:25.770Z
67b8749ffa8442592bce008e
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/ctbzupAxRhcNXDka75ANi.png
Ricardo Silveira Cabral
user
rscabral
66aaf835636a86cff6f5e84b
Robert Stojnic
66aaf835636a86cff6f5e84c
Roberta Raileanu
66aaf835636a86cff6f5e84d
Rohit Girdhar
66aaf835636a86cff6f5e84e
Rohit Patel
66aaf835636a86cff6f5e84f
Romain Sauvestre
66aaf835636a86cff6f5e850
Ronnie Polidoro
66aaf835636a86cff6f5e851
Roshan Sumbaly
66aaf835636a86cff6f5e852
Ross Taylor
claimed_verified
2025-02-12T09:19:26.421Z
64b808d9ff6d81ae29870b52
https://cdn-avatars.huggingface.co/v1/production/uploads/64b808d9ff6d81ae29870b52/Oo040VGSVy-9uuzFAb-GU.jpeg
Ross T
user
RJT1990
66aaf835636a86cff6f5e853
Ruan Silva
66aaf835636a86cff6f5e854
Rui Hou
66aaf835636a86cff6f5e855
Rui Wang
66aaf835636a86cff6f5e856
Saghar Hosseini
66aaf835636a86cff6f5e857
Sahana Chennabasappa
66aaf835636a86cff6f5e858
Sanjay Singh
66aaf835636a86cff6f5e859
Sean Bell
66aaf835636a86cff6f5e85a
Seohyun Sonia Kim
66aaf835636a86cff6f5e85b
Sergey Edunov
66aaf835636a86cff6f5e85c
Shaoliang Nie
66aaf835636a86cff6f5e85d
Sharan Narang
66aaf835636a86cff6f5e85e
Sharath Raparthy
66aaf835636a86cff6f5e85f
Sheng Shen
66aaf835636a86cff6f5e860
Shengye Wan
66aaf835636a86cff6f5e861
Shruti Bhosale
66aaf835636a86cff6f5e862
Shun Zhang
66aaf835636a86cff6f5e863
Simon Vandenhende
66aaf835636a86cff6f5e864
Soumya Batra
66aaf835636a86cff6f5e865
Spencer Whitman
66aaf835636a86cff6f5e866
Sten Sootla
66aaf835636a86cff6f5e867
Stephane Collot
66aaf835636a86cff6f5e868
Suchin Gururangan
66aaf835636a86cff6f5e869
Sydney Borodinsky
66aaf835636a86cff6f5e86a
Tamar Herman
66aaf835636a86cff6f5e86b
Tara Fowler
66aaf835636a86cff6f5e86c
Tarek Sheasha
66aaf835636a86cff6f5e86d
Thomas Georgiou
66aaf835636a86cff6f5e86e
Thomas Scialom
66aaf835636a86cff6f5e86f
Tobias Speckbacher
66aaf835636a86cff6f5e870
Todor Mihaylov
66aaf835636a86cff6f5e871
Tong Xiao
66aaf835636a86cff6f5e872
Ujjwal Karn
66aaf835636a86cff6f5e873
Vedanuj Goswami
66aaf835636a86cff6f5e874
Vibhor Gupta
66aaf835636a86cff6f5e875
Vignesh Ramanathan
66aaf835636a86cff6f5e876
Viktor Kerkez
66aaf835636a86cff6f5e877
Vincent Gonguet
66aaf835636a86cff6f5e878
Virginie Do
66aaf835636a86cff6f5e879
Vish Vogeti
66aaf835636a86cff6f5e87a
Vladan Petrovic
66aaf835636a86cff6f5e87b
Weiwei Chu
66aaf835636a86cff6f5e87c
Wenhan Xiong
66aaf835636a86cff6f5e87d
Wenyin Fu
66aaf835636a86cff6f5e87e
Whitney Meers
66aaf835636a86cff6f5e87f
Xavier Martinet
66aaf835636a86cff6f5e880
Xiaodong Wang
66aaf835636a86cff6f5e881
Xiaoqing Ellen Tan
66aaf835636a86cff6f5e882
Xinfeng Xie
66aaf835636a86cff6f5e883
Xuchao Jia
66aaf835636a86cff6f5e884
Xuewei Wang
66aaf835636a86cff6f5e885
Yaelle Goldschlag
66aaf835636a86cff6f5e886
Yashesh Gaur
66aaf835636a86cff6f5e887
Yasmine Babaei
66aaf835636a86cff6f5e888
Yi Wen
66aaf835636a86cff6f5e889
Yiwen Song
66aaf835636a86cff6f5e88a
Yuchen Zhang
66aaf835636a86cff6f5e88b
Yue Li
66aaf835636a86cff6f5e88c
Yuning Mao
66aaf835636a86cff6f5e88d
Zacharie Delpierre Coudert
66aaf835636a86cff6f5e88e
Zheng Yan
66aaf835636a86cff6f5e88f
Zhengxing Chen
66aaf835636a86cff6f5e890
Zoe Papakipos
66aaf835636a86cff6f5e891
Aaditya Singh
66aaf835636a86cff6f5e892
Aaron Grattafiori
66aaf835636a86cff6f5e893
Abha Jain
66aaf835636a86cff6f5e894
Adam Kelsey
66aaf835636a86cff6f5e895
Adam Shajnfeld
66aaf835636a86cff6f5e896
Adithya Gangidi
66aaf835636a86cff6f5e897
Adolfo Victoria
66aaf835636a86cff6f5e898
Ahuva Goldstand
66aaf835636a86cff6f5e899
Ajay Menon
66aaf835636a86cff6f5e89a
Ajay Sharma
66aaf835636a86cff6f5e89b
Alex Boesenberg
66aaf835636a86cff6f5e89c
Alex Vaughan
66aaf835636a86cff6f5e89d
Alexei Baevski
66aaf835636a86cff6f5e89e
Allie Feinstein
66aaf835636a86cff6f5e89f
Amanda Kallet
66aaf835636a86cff6f5e8a0
Amit Sangani
66aaf835636a86cff6f5e8a1
Anam Yunus
66aaf835636a86cff6f5e8a2
Andrei Lupu
66aaf835636a86cff6f5e8a3
Andres Alvarado
66aaf835636a86cff6f5e8a4
Andrew Caples
66aaf835636a86cff6f5e8a5
Andrew Gu
66aaf835636a86cff6f5e8a6
Andrew Ho
66aaf835636a86cff6f5e8a7
Andrew Poulton
66aaf835636a86cff6f5e8a8
Andrew Ryan
66aaf835636a86cff6f5e8a9
Ankit Ramchandani
66aaf835636a86cff6f5e8aa
Annie Franco
66aaf835636a86cff6f5e8ab
Aparajita Saraf
66aaf835636a86cff6f5e8ac
Arkabandhu Chowdhury
66aaf835636a86cff6f5e8ad
Ashley Gabriel
66aaf835636a86cff6f5e8ae
Ashwin Bharambe
66aaf835636a86cff6f5e8af
Assaf Eisenman
66aaf835636a86cff6f5e8b0
Azadeh Yazdan
66aaf835636a86cff6f5e8b1
Beau James
66aaf835636a86cff6f5e8b2
Ben Maurer
66aaf835636a86cff6f5e8b3
Benjamin Leonhardi
66aaf835636a86cff6f5e8b4
Bernie Huang
66aaf835636a86cff6f5e8b5
Beth Loyd
66aaf835636a86cff6f5e8b6
Beto De Paola
66aaf835636a86cff6f5e8b7
Bhargavi Paranjape
66aaf835636a86cff6f5e8b8
Bing Liu
66aaf835636a86cff6f5e8b9
Bo Wu
66aaf835636a86cff6f5e8ba
Boyu Ni
66aaf835636a86cff6f5e8bb
Braden Hancock
66aaf835636a86cff6f5e8bc
Bram Wasti
66aaf835636a86cff6f5e8bd
Brandon Spence
66aaf835636a86cff6f5e8be
Brani Stojkovic
66aaf835636a86cff6f5e8bf
Brian Gamido
66aaf835636a86cff6f5e8c0
Britt Montalvo
66aaf835636a86cff6f5e8c1
Carl Parker
66aaf835636a86cff6f5e8c2
Carly Burton
66aaf835636a86cff6f5e8c3
Catalina Mejia
66aaf835636a86cff6f5e8c4
Changhan Wang
66aaf835636a86cff6f5e8c5
Changkyu Kim
66aaf835636a86cff6f5e8c6
Chao Zhou
66aaf835636a86cff6f5e8c7
Chester Hu
66aaf835636a86cff6f5e8c8
Ching-Hsiang Chu
66aaf835636a86cff6f5e8c9
Chris Cai
66aaf835636a86cff6f5e8ca
Chris Tindal
66aaf835636a86cff6f5e8cb
Christoph Feichtenhofer
66aaf835636a86cff6f5e8cc
Damon Civin
66aaf835636a86cff6f5e8cd
Dana Beaty
66aaf835636a86cff6f5e8ce
Daniel Kreymer
66aaf835636a86cff6f5e8cf
Daniel Li
66aaf835636a86cff6f5e8d0
Danny Wyatt
66aaf835636a86cff6f5e8d1
David Adkins
66aaf835636a86cff6f5e8d2
David Xu
66aaf835636a86cff6f5e8d3
Davide Testuggine
66aaf835636a86cff6f5e8d4
Delia David
66aaf835636a86cff6f5e8d5
Devi Parikh
66aaf835636a86cff6f5e8d6
Diana Liskovich
66aaf835636a86cff6f5e8d7
Didem Foss
66aaf835636a86cff6f5e8d8
Dingkang Wang
66aaf835636a86cff6f5e8d9
Duc Le
66aaf835636a86cff6f5e8da
Dustin Holland
66aaf835636a86cff6f5e8db
Edward Dowling
66aaf835636a86cff6f5e8dc
Eissa Jamil
66aaf835636a86cff6f5e8dd
Elaine Montgomery
66aaf835636a86cff6f5e8de
Eleonora Presani
66aaf835636a86cff6f5e8df
Emily Hahn
66aaf835636a86cff6f5e8e0
Emily Wood
66aaf835636a86cff6f5e8e1
Erik Brinkman
66aaf835636a86cff6f5e8e2
Esteban Arcaute
66aaf835636a86cff6f5e8e3
Evan Dunbar
66aaf835636a86cff6f5e8e4
Evan Smothers
66aaf835636a86cff6f5e8e5
Fei Sun
66aaf835636a86cff6f5e8e6
Felix Kreuk
66aaf835636a86cff6f5e8e7
Feng Tian
66aaf835636a86cff6f5e8e8
Firat Ozgenel
66aaf835636a86cff6f5e8e9
Francesco Caggioni
66aaf835636a86cff6f5e8ea
Francisco Guzmán
66aaf835636a86cff6f5e8eb
Frank Kanayet
66aaf835636a86cff6f5e8ec
Frank Seide
66aaf835636a86cff6f5e8ed
Gabriela Medina Florez
66aaf835636a86cff6f5e8ee
Gabriella Schwarz
66aaf835636a86cff6f5e8ef
Gada Badeer
66aaf835636a86cff6f5e8f0
Georgia Swee
66aaf835636a86cff6f5e8f1
Gil Halpern
66aaf835636a86cff6f5e8f2
Govind Thattai
66aaf835636a86cff6f5e8f3
Grant Herman
66aaf835636a86cff6f5e8f4
Grigory Sizov
66aaf835636a86cff6f5e8f5
Guangyi
66aaf835636a86cff6f5e8f6
Zhang
66aaf835636a86cff6f5e8f7
Guna Lakshminarayanan
66aaf835636a86cff6f5e8f8
Hamid Shojanazeri
66aaf835636a86cff6f5e8f9
Han Zou
66aaf835636a86cff6f5e8fa
Hannah Wang
66aaf835636a86cff6f5e8fb
Hanwen Zha
66aaf835636a86cff6f5e8fc
Haroun Habeeb
66aaf835636a86cff6f5e8fd
Harrison Rudolph
66aaf835636a86cff6f5e8fe
Helen Suk
66aaf835636a86cff6f5e8ff
Henry Aspegren
66aaf835636a86cff6f5e900
Hunter Goldman
66aaf835636a86cff6f5e901
Igor Molybog
66aaf835636a86cff6f5e902
Igor Tufanov
66aaf835636a86cff6f5e903
Irina-Elena Veliche
66aaf835636a86cff6f5e904
Itai Gat
66aaf835636a86cff6f5e905
Jake Weissman
66aaf835636a86cff6f5e906
James Geboski
66aaf835636a86cff6f5e907
James Kohli
66aaf835636a86cff6f5e908
Japhet Asher
66aaf835636a86cff6f5e909
Jean-Baptiste Gaya
66aaf835636a86cff6f5e90a
Jeff Marcus
66aaf835636a86cff6f5e90b
Jeff Tang
66aaf835636a86cff6f5e90c
Jennifer Chan
66aaf835636a86cff6f5e90d
Jenny Zhen
66aaf835636a86cff6f5e90e
Jeremy Reizenstein
66aaf835636a86cff6f5e90f
Jeremy Teboul
66aaf835636a86cff6f5e910
Jessica Zhong
66aaf835636a86cff6f5e911
Jian Jin
66aaf835636a86cff6f5e912
Jingyi Yang
66aaf835636a86cff6f5e913
Joe Cummings
66aaf835636a86cff6f5e914
Jon Carvill
66aaf835636a86cff6f5e915
Jon Shepard
66aaf835636a86cff6f5e916
Jonathan McPhie
66aaf835636a86cff6f5e917
Jonathan Torres
66aaf835636a86cff6f5e918
Josh Ginsburg
66aaf835636a86cff6f5e919
Junjie Wang
66aaf835636a86cff6f5e91a
Kai Wu
claimed_verified
2024-08-09T17:43:13.267Z
660b40d048408366ccbe0769
https://cdn-avatars.huggingface.co/v1/production/uploads/660b40d048408366ccbe0769/MyWwlqNMHXc9gb_ygYKHs.jpeg
Kai Wu
user
wukaixingxp
66aaf835636a86cff6f5e91b
Kam Hou U
66aaf835636a86cff6f5e91c
Karan Saxena
claimed_verified
2025-03-06T09:28:25.730Z
6601b3c3d2a378a163654efc
/avatars/9ae79093b80997de76f1e57c134548d0.svg
Karan Saxena
user
weight-matrix
66aaf835636a86cff6f5e91d
Karthik Prasad
66aaf835636a86cff6f5e91e
Kartikay Khandelwal
66aaf835636a86cff6f5e91f
Katayoun Zand
66aaf835636a86cff6f5e920
Kathy Matosich
66aaf835636a86cff6f5e921
Kaushik Veeraraghavan
66aaf835636a86cff6f5e922
Kelly Michelena
66aaf835636a86cff6f5e923
Keqian Li
66aaf835636a86cff6f5e924
Kun Huang
66aaf835636a86cff6f5e925
Kunal Chawla
66aaf835636a86cff6f5e926
Kushal Lakhotia
66aaf835636a86cff6f5e927
Kyle Huang
66aaf835636a86cff6f5e928
Lailin Chen
66aaf835636a86cff6f5e929
Lakshya Garg
66aaf835636a86cff6f5e92a
Lavender A
66aaf835636a86cff6f5e92b
Leandro Silva
66aaf835636a86cff6f5e92c
Lee Bell
66aaf835636a86cff6f5e92d
Lei Zhang
66aaf835636a86cff6f5e92e
Liangpeng Guo
66aaf835636a86cff6f5e92f
Licheng Yu
66aaf835636a86cff6f5e930
Liron Moshkovich
66aaf835636a86cff6f5e931
Luca Wehrstedt
66aaf835636a86cff6f5e932
Madian Khabsa
66aaf835636a86cff6f5e933
Manav Avalani
66aaf835636a86cff6f5e934
Manish Bhatt
66aaf835636a86cff6f5e935
Maria Tsimpoukelli
66aaf835636a86cff6f5e936
Martynas Mankus
66aaf835636a86cff6f5e937
Matan Hasson
66aaf835636a86cff6f5e938
Matthew Lennie
66aaf835636a86cff6f5e939
Matthias Reso
66aaf835636a86cff6f5e93a
Maxim Groshev
66aaf835636a86cff6f5e93b
Maxim Naumov
66aaf835636a86cff6f5e93c
Maya Lathi
66aaf835636a86cff6f5e93d
Meghan Keneally
66aaf835636a86cff6f5e93e
Michael L. Seltzer
66aaf835636a86cff6f5e93f
Michal Valko
claimed_verified
2024-11-15T09:46:17.269Z
651e97156d92456bdf5ace6b
https://cdn-avatars.huggingface.co/v1/production/uploads/651e97156d92456bdf5ace6b/KKfdZGPAcWPdqycp9SulH.jpeg
Michal Valko
user
misovalko
66aaf835636a86cff6f5e940
Michelle Restrepo
66aaf835636a86cff6f5e941
Mihir Patel
66aaf835636a86cff6f5e942
Mik Vyatskov
66aaf835636a86cff6f5e943
Mikayel Samvelyan
66aaf835636a86cff6f5e944
Mike Clark
66aaf835636a86cff6f5e945
Mike Macey
66aaf835636a86cff6f5e946
Mike Wang
66aaf835636a86cff6f5e947
Miquel Jubert Hermoso
66aaf835636a86cff6f5e948
Mo Metanat
66aaf835636a86cff6f5e949
Mohammad Rastegari
66aaf835636a86cff6f5e94a
Munish Bansal
66aaf835636a86cff6f5e94b
Nandhini Santhanam
66aaf835636a86cff6f5e94c
Natascha Parks
66aaf835636a86cff6f5e94d
Natasha White
66aaf835636a86cff6f5e94e
Navyata Bawa
66aaf835636a86cff6f5e94f
Nayan Singhal
66aaf835636a86cff6f5e950
Nick Egebo
66aaf835636a86cff6f5e951
Nicolas Usunier
66aaf835636a86cff6f5e952
Nikolay Pavlovich Laptev
66aaf835636a86cff6f5e953
Ning Dong
66aaf835636a86cff6f5e954
Ning Zhang
66aaf835636a86cff6f5e955
Norman Cheng
66aaf835636a86cff6f5e956
Oleg Chernoguz
66aaf835636a86cff6f5e957
Olivia Hart
66aaf835636a86cff6f5e958
Omkar Salpekar
66aaf835636a86cff6f5e959
Ozlem Kalinli
66aaf835636a86cff6f5e95a
Parkin Kent
66aaf835636a86cff6f5e95b
Parth Parekh
66aaf835636a86cff6f5e95c
Paul Saab
66aaf835636a86cff6f5e95d
Pavan Balaji
66aaf835636a86cff6f5e95e
Pedro Rittner
66aaf835636a86cff6f5e95f
Philip Bontrager
66aaf835636a86cff6f5e960
Pierre Roux
66aaf835636a86cff6f5e961
Piotr Dollar
66aaf835636a86cff6f5e962
Polina Zvyagina
66aaf835636a86cff6f5e963
Prashant Ratanchandani
66aaf835636a86cff6f5e964
Pritish Yuvraj
claimed_verified
2024-10-04T20:11:43.121Z
65c30d162a023e7ea97c160f
/avatars/f17eaa12dd4c4a383fb741f7ae5b9432.svg
Pritish Yuvraj
user
pyuvraj
66aaf835636a86cff6f5e965
Qian Liang
66aaf835636a86cff6f5e966
Rachad Alao
66aaf835636a86cff6f5e967
Rachel Rodriguez
66aaf835636a86cff6f5e968
Rafi Ayub
66aaf835636a86cff6f5e969
Raghotham Murthy
66aaf835636a86cff6f5e96a
Raghu Nayani
66aaf835636a86cff6f5e96b
Rahul Mitra
66aaf835636a86cff6f5e96c
Raymond Li
66aaf835636a86cff6f5e96d
Rebekkah Hogan
66aaf835636a86cff6f5e96e
Robin Battey
66aaf835636a86cff6f5e96f
Rocky Wang
66aaf835636a86cff6f5e970
Rohan Maheswari
66aaf835636a86cff6f5e971
Russ Howes
66aaf835636a86cff6f5e972
Ruty Rinott
66aaf835636a86cff6f5e973
Sai Jayesh Bondu
66aaf835636a86cff6f5e974
Samyak Datta
66aaf835636a86cff6f5e975
Sara Chugh
66aaf835636a86cff6f5e976
Sara Hunt
66aaf835636a86cff6f5e977
Sargun Dhillon
66aaf835636a86cff6f5e978
Sasha Sidorov
66aaf835636a86cff6f5e979
Satadru Pan
66aaf835636a86cff6f5e97a
Saurabh Verma
66aaf835636a86cff6f5e97b
Seiji Yamamoto
66aaf835636a86cff6f5e97c
Sharadh Ramaswamy
66aaf835636a86cff6f5e97d
Shaun Lindsay
66aaf835636a86cff6f5e97e
Shaun Lindsay
66aaf835636a86cff6f5e97f
Sheng Feng
66aaf835636a86cff6f5e980
Shenghao Lin
66aaf835636a86cff6f5e981
Shengxin Cindy Zha
66aaf835636a86cff6f5e982
Shiva Shankar
66aaf835636a86cff6f5e983
Shuqiang Zhang
66aaf835636a86cff6f5e984
Shuqiang Zhang
66aaf835636a86cff6f5e985
Sinong Wang
66aaf835636a86cff6f5e986
Sneha Agarwal
66aaf835636a86cff6f5e987
Soji Sajuyigbe
66aaf835636a86cff6f5e988
Soumith Chintala
66aaf835636a86cff6f5e989
Stephanie Max
66aaf835636a86cff6f5e98a
Stephen Chen
66aaf835636a86cff6f5e98b
Steve Kehoe
66aaf835636a86cff6f5e98c
Steve Satterfield
66aaf835636a86cff6f5e98d
Sudarshan Govindaprasad
66aaf835636a86cff6f5e98e
Sumit Gupta
66aaf835636a86cff6f5e98f
Sungmin Cho
66aaf835636a86cff6f5e990
Sunny Virk
66aaf835636a86cff6f5e991
Suraj Subramanian
66aaf835636a86cff6f5e992
Sy Choudhury
66aaf835636a86cff6f5e993
Sydney Goldman
66aaf835636a86cff6f5e994
Tal Remez
66aaf835636a86cff6f5e995
Tamar Glaser
66aaf835636a86cff6f5e996
Tamara Best
66aaf835636a86cff6f5e997
Thilo Kohler
66aaf835636a86cff6f5e998
Thomas Robinson
66aaf835636a86cff6f5e999
Tianhe Li
66aaf835636a86cff6f5e99a
Tianjun Zhang
claimed_verified
2024-08-01T07:00:20.001Z
6374cd6b6ea8da14f8fef8dc
https://cdn-avatars.huggingface.co/v1/production/uploads/6374cd6b6ea8da14f8fef8dc/l13bg0tKDjCnUw3I895QZ.png
Tianjun Zhang
user
tianjunz
66aaf835636a86cff6f5e99b
Tim Matthews
66aaf835636a86cff6f5e99c
Timothy Chou
66aaf835636a86cff6f5e99d
Tzook Shaked
66aaf835636a86cff6f5e99e
Varun Vontimitta
66aaf835636a86cff6f5e99f
Victoria Ajayi
66aaf835636a86cff6f5e9a0
Victoria Montanez
66aaf835636a86cff6f5e9a1
Vijai Mohan
66aaf835636a86cff6f5e9a2
Vinay Satish Kumar
66aaf835636a86cff6f5e9a3
Vishal Mangla
66aaf835636a86cff6f5e9a4
Vlad Ionescu
66aaf835636a86cff6f5e9a5
Vlad Poenaru
66aaf835636a86cff6f5e9a6
Vlad Tiberiu Mihailescu
66aaf835636a86cff6f5e9a7
Vladimir Ivanov
66aaf835636a86cff6f5e9a8
Wei Li
66aaf835636a86cff6f5e9a9
Wenchen Wang
66aaf835636a86cff6f5e9aa
Wenwen Jiang
66aaf835636a86cff6f5e9ab
Wes Bouaziz
66aaf835636a86cff6f5e9ac
Will Constable
66aaf835636a86cff6f5e9ad
Xiaocheng Tang
66aaf835636a86cff6f5e9ae
Xiaofang Wang
66aaf835636a86cff6f5e9af
Xiaojian Wu
66aaf835636a86cff6f5e9b0
Xiaolan Wang
66aaf835636a86cff6f5e9b1
Xide Xia
66aaf835636a86cff6f5e9b2
Xilun Wu
66aaf835636a86cff6f5e9b3
Xinbo Gao
66aaf835636a86cff6f5e9b4
Yanjun Chen
66aaf835636a86cff6f5e9b5
Ye Hu
66aaf835636a86cff6f5e9b6
Ye Jia
66aaf835636a86cff6f5e9b7
Ye Qi
66aaf835636a86cff6f5e9b8
Yenda Li
66aaf835636a86cff6f5e9b9
Yilin Zhang
66aaf835636a86cff6f5e9ba
Ying Zhang
66aaf835636a86cff6f5e9bb
Yossi Adi
66aaf835636a86cff6f5e9bc
Youngjin Nam
66aaf835636a86cff6f5e9bd
Yu
66aaf835636a86cff6f5e9be
Wang
66aaf835636a86cff6f5e9bf
Yuchen Hao
66aaf835636a86cff6f5e9c0
Yundi Qian
66aaf835636a86cff6f5e9c1
Yuzi He
66aaf835636a86cff6f5e9c2
Zach Rait
66aaf835636a86cff6f5e9c3
Zachary DeVito
66aaf835636a86cff6f5e9c4
Zef Rosnbrick
66aaf835636a86cff6f5e9c5
Zhaoduo Wen
66aaf835636a86cff6f5e9c6
Zhenyu Yang
66aaf835636a86cff6f5e9c7
Zhiwei Zhao
The Llama 3 Herd of Models
Modern artificial intelligence (AI) systems are powered by foundation models.
This paper presents a new set of foundation models, called Llama 3. It is a
herd of language models that natively support multilinguality, coding,
reasoning, and tool usage. Our largest model is a dense Transformer with 405B
parameters and a context window of up to 128K tokens. This paper presents an
extensive empirical evaluation of Llama 3. We find that Llama 3 delivers
comparable quality to leading language models such as GPT-4 on a plethora of
tasks. We publicly release Llama 3, including pre-trained and post-trained
versions of the 405B parameter language model and our Llama Guard 3 model for
input and output safety. The paper also presents the results of experiments in
which we integrate image, video, and speech capabilities into Llama 3 via a
compositional approach. We observe this approach performs competitively with
the state-of-the-art on image, video, and speech recognition tasks. The
resulting models are not yet being broadly released as they are still under
development.
Llama 3, a multilingual and multi-modal language model with 405B parameters, achieves competitive performance across tasks including image, video, and speech recognition when integrated through a compositional approach.
Transformer multilinguality coding reasoning tool usage pre-trained post-trained compositional approach image recognition video recognition speech recognition