Purple Llama CyberSecEval: A Secure Coding Benchmark for Language Models
This paper presents CyberSecEval, a comprehensive benchmark developed to help
bolster the cybersecurity of Large Language Models (LLMs) employed as coding
assistants. As what we believe to be the most extensive unified cybersecurity
safety benchmark to date, CyberSecEval provides a thorough evaluation of LLMs
in two crucial security domains: their propensity to generate insecure code and
their level of compliance when asked to assist in cyberattacks. Through a case
study involving seven models from the Llama 2, Code Llama, and OpenAI GPT large
language model families, CyberSecEval effectively pinpointed key cybersecurity
risks. More importantly, it offered practical insights for refining these
models. A significant observation from the study was the tendency of more
advanced models to suggest insecure code, highlighting the critical need for
integrating security considerations in the development of sophisticated LLMs.
CyberSecEval, with its automated test case generation and evaluation pipeline
covers a broad scope and equips LLM designers and researchers with a tool to
broadly measure and enhance the cybersecurity safety properties of LLMs,
contributing to the development of more secure AI systems.
6576739cb238c76bba21eadb
Manish Bhatt
6576739cb238c76bba21eadc
Sahana Chennabasappa
6576739cb238c76bba21eadd
Cyrus Nikolaidis
admin_assigned
2023-12-11T08:33:32.683Z
63153d9a27d020853f67f061
https://cdn-avatars.huggingface.co/v1/production/uploads/63153d9a27d020853f67f061/qKFIxr6mmga1yktDovRwI.jpeg
Cyrus Nikolaidis
user
cynikolai
6576739cb238c76bba21eade
Shengye Wan
6576739cb238c76bba21eadf
Ivan Evtimov
6576739cb238c76bba21eae0
Dominik Gabi
admin_assigned
2023-12-11T08:33:49.181Z
656e185f90d556ffa65447c2
/avatars/95c560617999506b588eb506beb6fa44.svg
Dominik Gabi
user
dkgi
6576739cb238c76bba21eae1
Daniel Song
6576739cb238c76bba21eae2
Faizan Ahmad
6576739cb238c76bba21eae3
Cornelius Aschermann
6576739cb238c76bba21eae4
Lorenzo Fontana
6576739cb238c76bba21eae5
Sasha Frolov
6576739cb238c76bba21eae6
Ravi Prakash Giri
6576739cb238c76bba21eae7
Dhaval Kapil
6576739cb238c76bba21eae8
Yiannis Kozyrakis
6576739cb238c76bba21eae9
David LeBlanc
6576739cb238c76bba21eaea
James Milazzo
6576739cb238c76bba21eaeb
Aleksandar Straumann
6576739cb238c76bba21eaec
Gabriel Synnaeve
admin_assigned
2023-12-11T08:36:51.081Z
630eac7931970d1cd4fbacf2
/avatars/b7ccbddfa745db854dc342be1327cd53.svg
Gabriel Synnaeve
user
gsynnaeve
6576739cb238c76bba21eaed
Varun Vontimitta
admin_assigned
2023-12-11T08:36:58.410Z
64c935906a26cddbecc038dd
https://cdn-avatars.huggingface.co/v1/production/uploads/64c935906a26cddbecc038dd/8egryWsivgNoH89zaeoRX.png
Varun Vontimitta
user
vontimitta
6576739cb238c76bba21eaee
Spencer Whitman
admin_assigned
2023-12-11T08:37:04.362Z
65710fdec4993b8fb981cff0
/avatars/250e2adb2cf05628431531d7a49ced50.svg
Spencer Whitman
user
spencerwmeta
6576739cb238c76bba21eaef
Joshua Saxe
admin_assigned
2023-12-11T08:37:10.919Z
64f8e03935a0a9fc5452f5e7
/avatars/24eccd7961d54cba1aae8fc4a431ce3d.svg
Joshua Saxe
user
jdsaxe
Purple Llama CyberSecEval: A Secure Coding Benchmark for Language Models
This paper presents CyberSecEval, a comprehensive benchmark developed to help
bolster the cybersecurity of Large Language Models (LLMs) employed as coding
assistants. As what we believe to be the most extensive unified cybersecurity
safety benchmark to date, CyberSecEval provides a thorough evaluation of LLMs
in two crucial security domains: their propensity to generate insecure code and
their level of compliance when asked to assist in cyberattacks. Through a case
study involving seven models from the Llama 2, Code Llama, and OpenAI GPT large
language model families, CyberSecEval effectively pinpointed key cybersecurity
risks. More importantly, it offered practical insights for refining these
models. A significant observation from the study was the tendency of more
advanced models to suggest insecure code, highlighting the critical need for
integrating security considerations in the development of sophisticated LLMs.
CyberSecEval, with its automated test case generation and evaluation pipeline
covers a broad scope and equips LLM designers and researchers with a tool to
broadly measure and enhance the cybersecurity safety properties of LLMs,
contributing to the development of more secure AI systems.
CyberSecEval is a benchmark that evaluates the cybersecurity of large language models, focusing on insecure code generation and compliance with cyberattacks, providing insights for enhancing model security.
Large Language Models LLMs CyberSecEval insecure code cybersecurity cyberattacks