Open-Sourcing Highly Capable Foundation Models: An evaluation of risks,
  benefits, and alternative methods for pursuing open-source objectives
Recent decisions by leading AI labs to either open-source their models or to
restrict access to their models has sparked debate about whether, and how,
increasingly capable AI models should be shared. Open-sourcing in AI typically
refers to making model architecture and weights freely and publicly accessible
for anyone to modify, study, build on, and use. This offers advantages such as
enabling external oversight, accelerating progress, and decentralizing control
over AI development and use. However, it also presents a growing potential for
misuse and unintended consequences. This paper offers an examination of the
risks and benefits of open-sourcing highly capable foundation models. While
open-sourcing has historically provided substantial net benefits for most
software and AI development processes, we argue that for some highly capable
foundation models likely to be developed in the near future, open-sourcing may
pose sufficiently extreme risks to outweigh the benefits. In such a case,
highly capable foundation models should not be open-sourced, at least not
initially. Alternative strategies, including non-open-source model sharing
options, are explored. The paper concludes with recommendations for developers,
standard-setting bodies, and governments for establishing safe and responsible
model sharing practices and preserving open-source benefits where safe.
6556ea3747c93d37a888a853
Elizabeth Seger
6556ea3747c93d37a888a854
Noemi Dreksler
admin_assigned
2023-11-17T16:13:58.340Z
64623caab438438da3bff220
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/he62MWI9BYT5YyEG5BsIh.png
Noemi Dreksler
user
noemidreksler
6556ea3747c93d37a888a855
Richard Moulange
6556ea3747c93d37a888a856
Emily Dardaman
6556ea3747c93d37a888a857
Jonas Schuett
admin_assigned
2023-11-17T16:14:16.805Z
64622cfcb7fb9d680861af77
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/2FpECzBD8aOiUagRlCnVZ.jpeg
Jonas Schuett
user
jonasschuett
6556ea3747c93d37a888a858
K. Wei
6556ea3747c93d37a888a859
Christoph Winter
admin_assigned
2023-11-17T16:14:28.448Z
6483718a6502bafcd84f6afb
/avatars/25bb25d17a457f0da126c78d2d0a7dcb.svg
Christoph Winter
user
chrihech
6556ea3747c93d37a888a85a
Mackenzie Arnold
6556ea3747c93d37a888a85b
Seán Ó hÉigeartaigh
6556ea3747c93d37a888a85c
Anton Korinek
6556ea3747c93d37a888a85d
Markus Anderljung
admin_assigned
2023-11-17T16:14:45.489Z
64624f222a83863b97bda981
/avatars/bd13153c1358d6cdcb7959478ef5f3e1.svg
Markus Anderljung
user
markusanderljung
6556ea3747c93d37a888a85e
Ben Bucknall
6556ea3747c93d37a888a85f
Alan Chan
6556ea3747c93d37a888a860
Eoghan Stafford
claimed_verified
2023-12-05T08:41:45.625Z
656e8be8a2076764c8d4f354
/avatars/528fd1296774101c5aba701269efd0dd.svg
Eoghan Stafford
user
EoghanStafford
6556ea3747c93d37a888a861
Leonie Koessler
6556ea3747c93d37a888a862
Aviv Ovadya
6556ea3747c93d37a888a863
Ben Garfinkel
6556ea3747c93d37a888a864
Emma Bluemke
6556ea3747c93d37a888a865
Michael Aird
6556ea3747c93d37a888a866
Patrick Levermore
6556ea3747c93d37a888a867
Julian Hazell
6556ea3747c93d37a888a868
Abhishek Gupta
Open-Sourcing Highly Capable Foundation Models: An evaluation of risks,
  benefits, and alternative methods for pursuing open-source objectives
Recent decisions by leading AI labs to either open-source their models or to
restrict access to their models has sparked debate about whether, and how,
increasingly capable AI models should be shared. Open-sourcing in AI typically
refers to making model architecture and weights freely and publicly accessible
for anyone to modify, study, build on, and use. This offers advantages such as
enabling external oversight, accelerating progress, and decentralizing control
over AI development and use. However, it also presents a growing potential for
misuse and unintended consequences. This paper offers an examination of the
risks and benefits of open-sourcing highly capable foundation models. While
open-sourcing has historically provided substantial net benefits for most
software and AI development processes, we argue that for some highly capable
foundation models likely to be developed in the near future, open-sourcing may
pose sufficiently extreme risks to outweigh the benefits. In such a case,
highly capable foundation models should not be open-sourced, at least not
initially. Alternative strategies, including non-open-source model sharing
options, are explored. The paper concludes with recommendations for developers,
standard-setting bodies, and governments for establishing safe and responsible
model sharing practices and preserving open-source benefits where safe.
The paper discusses the risks and benefits of open-sourcing highly capable AI foundation models and recommends strategies for safe and responsible model sharing.