title: OpenFlamingo: An Open-Source Framework for Training Large Autoregressive
    Vision-Language Models
summary: We introduce OpenFlamingo, a family of autoregressive vision-language models
  ranging from 3B to 9B parameters. OpenFlamingo is an ongoing effort to produce
  an open-source replication of DeepMind's Flamingo models. On seven
  vision-language datasets, OpenFlamingo models average between 80 - 89% of
  corresponding Flamingo performance. This technical report describes our models,
  training data, hyperparameters, and evaluation suite. We share our models and
  code at https://github.com/mlfoundations/open_flamingo.
paper_authors._id: 64cc54d88256a8efea6ca705
paper_authors.name: Anas Awadalla
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2023-08-04T11:40:26.281Z
paper_authors._id: 60f1ab3afe0d78e01037eeb1
paper_authors.avatarUrl: /avatars/f784fa423fd84fffb4683fa837ffc5a3.svg
paper_authors.fullname: Anas Awadalla
paper_authors.type: user
paper_authors.user: anas-awadalla
paper_authors._id: 64cc54d88256a8efea6ca706
paper_authors.name: Irena Gao
paper_authors._id: 64cc54d88256a8efea6ca707
paper_authors.name: Josh Gardner
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-08-04T11:50:22.331Z
paper_authors._id: 63e6d6b22d2c508de90153a1
paper_authors.avatarUrl: /avatars/11d653e5376bd122ff82778a8393f541.svg
paper_authors.fullname: Josh Gardner
paper_authors.type: user
paper_authors.user: jpgard
paper_authors._id: 64cc54d88256a8efea6ca708
paper_authors.name: Jack Hessel
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-08-04T11:51:00.126Z
paper_authors._id: 625498644f4edf771516b2cb
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/1664497251391-625498644f4edf771516b2cb.jpeg
paper_authors.fullname: Jack Hessel
paper_authors.type: user
paper_authors.user: jmhessel
paper_authors._id: 64cc54d88256a8efea6ca709
paper_authors.name: Yusuf Hanafy
paper_authors._id: 64cc54d88256a8efea6ca70a
paper_authors.name: Wanrong Zhu
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2023-08-16T13:23:31.161Z
paper_authors._id: 633a7e91c8eb7b089034fb3c
paper_authors.avatarUrl: /avatars/0e03d80aa469de131cc17bb0c5c016b9.svg
paper_authors.fullname: Wanrong Zhu
paper_authors.type: user
paper_authors.user: VegB
paper_authors._id: 64cc54d88256a8efea6ca70b
paper_authors.name: Kalyani Marathe
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-08-04T11:52:08.508Z
paper_authors._id: 649be93e6985c787d4946e87
paper_authors.avatarUrl: /avatars/0f23f8a3c644c81c84aa11786b2f358e.svg
paper_authors.fullname: Kalyani Marathe
paper_authors.type: user
paper_authors.user: kalyani7195
paper_authors._id: 64cc54d88256a8efea6ca70c
paper_authors.name: Yonatan Bitton
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-08-04T11:53:11.847Z
paper_authors._id: 632e0771ae0a7b1fc95630bf
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/1663961181981-632e0771ae0a7b1fc95630bf.jpeg
paper_authors.fullname: Yonatan
paper_authors.type: user
paper_authors.user: yonatanbitton
paper_authors._id: 64cc54d88256a8efea6ca70d
paper_authors.name: Samir Gadre
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-08-04T11:53:29.908Z
paper_authors._id: 62be1cd77c0388414f012f23
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/1656626356583-noauth.jpeg
paper_authors.fullname: Samir Gadre
paper_authors.type: user
paper_authors.user: samirg
paper_authors._id: 64cc54d88256a8efea6ca70e
paper_authors.name: Shiori Sagawa
paper_authors._id: 64cc54d88256a8efea6ca70f
paper_authors.name: Jenia Jitsev
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-08-04T11:54:46.830Z
paper_authors._id: 6355b485b8b79340d4630dd5
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6355b485b8b79340d4630dd5/HIZO4ybweRy48VdCtk2MB.jpeg
paper_authors.fullname: Jenia Jitsev
paper_authors.type: user
paper_authors.user: JJitsev
paper_authors._id: 64cc54d88256a8efea6ca710
paper_authors.name: Simon Kornblith
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-08-04T11:55:03.705Z
paper_authors._id: 6443ffc2af034cdfd69c5c00
paper_authors.avatarUrl: /avatars/0c12cf9baaf3b24a02ffb42238cdc6df.svg
paper_authors.fullname: Simon Kornblith
paper_authors.type: user
paper_authors.user: simonsterk
paper_authors._id: 64cc54d88256a8efea6ca711
paper_authors.name: Pang Wei Koh
paper_authors._id: 64cc54d88256a8efea6ca712
paper_authors.name: Gabriel Ilharco
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-08-04T11:55:28.793Z
paper_authors._id: 635c1b2986f52b24c1e9fde3
paper_authors.avatarUrl: /avatars/d53dee91892cccfd0c4d7353ffb67cbf.svg
paper_authors.fullname: Gabriel Ilharco
paper_authors.type: user
paper_authors.user: gabrielilharco
paper_authors._id: 64cc54d88256a8efea6ca713
paper_authors.name: Mitchell Wortsman
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-08-04T11:56:07.074Z
paper_authors._id: 638e42f96251c8bd7ab84089
paper_authors.avatarUrl: /avatars/cb7a7f902846bd9710e2c48a50ce3527.svg
paper_authors.fullname: Mitchell Wortsman
paper_authors.type: user
paper_authors.user: mitchellw
paper_authors._id: 64cc54d88256a8efea6ca714
paper_authors.name: Ludwig Schmidt
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-08-04T11:56:33.811Z
paper_authors._id: 6252375c818a5dc29ab9d945
paper_authors.avatarUrl: /avatars/cd4f0b220ea36e13ff71157cffe9d9d1.svg
paper_authors.fullname: Ludwig Schmidt
paper_authors.type: user
paper_authors.user: ludwigschmidt
paper_title: OpenFlamingo: An Open-Source Framework for Training Large Autoregressive
    Vision-Language Models
paper_summary: We introduce OpenFlamingo, a family of autoregressive vision-language models
  ranging from 3B to 9B parameters. OpenFlamingo is an ongoing effort to produce
  an open-source replication of DeepMind's Flamingo models. On seven
  vision-language datasets, OpenFlamingo models average between 80 - 89% of
  corresponding Flamingo performance. This technical report describes our models,
  training data, hyperparameters, and evaluation suite. We share our models and
  code at https://github.com/mlfoundations/open_flamingo.
paper_ai_keywords: large language models parameters large vision models language models DeepMind's Flamingo models vision-language datasets hyperparameters evaluation suite supervised learning