Llama-3.1-FoundationAI-SecurityLLM-Base-8B Technical Report
As transformer-based large language models (LLMs) increasingly permeate
society, they have revolutionized domains such as software engineering,
creative writing, and digital arts. However, their adoption in cybersecurity
remains limited due to challenges like scarcity of specialized training data
and complexity of representing cybersecurity-specific knowledge. To address
these gaps, we present Foundation-Sec-8B, a cybersecurity-focused LLM built on
the Llama 3.1 architecture and enhanced through continued pretraining on a
carefully curated cybersecurity corpus. We evaluate Foundation-Sec-8B across
both established and new cybersecurity benchmarks, showing that it matches
Llama 3.1-70B and GPT-4o-mini in certain cybersecurity-specific tasks. By
releasing our model to the public, we aim to accelerate progress and adoption
of AI-driven tools in both public and private cybersecurity contexts.
6812f89338bee548818e68a1
Paul Kassianik
extracted_confirmed
2025-05-01T04:29:53.088Z
6573a9fe769f3ee9bdf4d9c7
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/xC41F7Vp9SVzVHc3cUiRU.jpeg
Paul Kassianik
user
paulkass
6812f89338bee548818e68a2
Baturay Saglam
admin_assigned
2025-05-05T08:01:50.509Z
67326fd19417d7f51a9dc559
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/U9a4fHjrJjzXkTFfiafjI.png
Baturay Saglam
user
baturaysaglam
6812f89338bee548818e68a3
Alexander Chen
claimed_verified
2025-05-20T07:23:05.103Z
682bc536a08ed10f5fa177e6
/avatars/ab5697bb2f806a3955043fa8942ed16a.svg
Alexander Chen
user
alexchen92
6812f89338bee548818e68a4
Blaine Nelson
6812f89338bee548818e68a5
Anu Vellore
admin_assigned
2025-05-05T08:02:16.802Z
651c8d2909debbe627af9fc5
/avatars/332c158d0d157c328fbc65e25cbdd02f.svg
Anu Vellore
user
anuvellore
6812f89338bee548818e68a6
Massimo Aufiero
admin_assigned
2025-05-05T08:02:22.238Z
636a82a34d1bade3ca8478b8
/avatars/936b38f82df08d3e71277ff759b85594.svg
Massimo Aufiero
user
aufieroma
6812f89338bee548818e68a7
Fraser Burch
claimed_verified
2025-05-02T06:34:53.958Z
6510b3fabfb7dd98bbf55fa6
/avatars/bf3970d58caee2a7b168328418d2b5d1.svg
Fraser Burch
user
Frase
6812f89338bee548818e68a8
Dhruv Kedia
6812f89338bee548818e68a9
Avi Zohary
admin_assigned
2025-05-05T08:02:44.481Z
67f5bc1288885c9950bc3060
/avatars/b9bcbdf9fdad008c46ec8085f3415d60.svg
Avi Zohary
user
AviZo
6812f89338bee548818e68aa
Sajana Weerawardhena
6812f89338bee548818e68ab
Aman Priyanshu
claimed_verified
2025-05-02T06:34:56.066Z
620042b28c2eb991da50d34e
https://cdn-avatars.huggingface.co/v1/production/uploads/620042b28c2eb991da50d34e/Q5cj1GIq3XnKj-K64Mtyd.jpeg
Aman Priyanshu
user
AmanPriyanshu
6812f89338bee548818e68ac
Adam Swanda
admin_assigned
2025-05-05T08:03:23.920Z
6388d57b5a3d2a3356240fc0
https://cdn-avatars.huggingface.co/v1/production/uploads/1669911914384-noauth.jpeg
Adam Swanda
user
deadbits
6812f89338bee548818e68ad
Amy Chang
claimed_verified
2025-06-04T09:04:52.140Z
67db21120811453f6e6d1441
/avatars/0bc82fbf8ce2a199329e875767e33e33.svg
Amy Chang
user
n0tjustanychang
6812f89338bee548818e68ae
Hyrum Anderson
admin_assigned
2025-05-05T08:03:30.859Z
62b5e2b5a373ba2c53ebace4
https://cdn-avatars.huggingface.co/v1/production/uploads/1656087519480-62b5e2b5a373ba2c53ebace4.jpeg
Hyrum Anderson
user
drhyrum
6812f89338bee548818e68af
Kojin Oshiba
6812f89338bee548818e68b0
Omar Santos
admin_assigned
2025-05-05T08:04:30.924Z
644f49b2030210812f478a23
https://cdn-avatars.huggingface.co/v1/production/uploads/644f49b2030210812f478a23/Wzee6t75EMu7Z4eGgOMq0.jpeg
Omar Santos
user
santosomar
6812f89338bee548818e68b1
Yaron Singer
admin_assigned
2025-05-05T08:04:25.095Z
65028970d4b64cadd2d2ae58
/avatars/b6b81b853babffa9abfd395c51eaaef1.svg
Yaron Singer
user
yaronsinger
6812f89338bee548818e68b2
Amin Karbasi
Llama-3.1-FoundationAI-SecurityLLM-Base-8B Technical Report
As transformer-based large language models (LLMs) increasingly permeate
society, they have revolutionized domains such as software engineering,
creative writing, and digital arts. However, their adoption in cybersecurity
remains limited due to challenges like scarcity of specialized training data
and complexity of representing cybersecurity-specific knowledge. To address
these gaps, we present Foundation-Sec-8B, a cybersecurity-focused LLM built on
the Llama 3.1 architecture and enhanced through continued pretraining on a
carefully curated cybersecurity corpus. We evaluate Foundation-Sec-8B across
both established and new cybersecurity benchmarks, showing that it matches
Llama 3.1-70B and GPT-4o-mini in certain cybersecurity-specific tasks. By
releasing our model to the public, we aim to accelerate progress and adoption
of AI-driven tools in both public and private cybersecurity contexts.
Foundation-Sec-8B, a LLM enhanced with cybersecurity-specific training, matches high-performance models in cybersecurity tasks and promotes AI adoption in the field.
transformer-based large language models LLMs Llama 3.1 GPT-4o-mini cybersecurity-focused LLM continued pretraining cybersecurity corpus cybersecurity benchmarks