Answers.Body: <p>The GPT-3 source code hasn’t been released but the creators say it uses the “same model and architecture as GPT-2” <a href="https://arxiv.org/abs/2005.14165" rel="noreferrer">(source)</a> with some exceptions.</p>
  <p>The GPT-2 <a href="https://github.com/openai/gpt-2" rel="noreferrer">source code</a> is written in 100% Python. The model is based on Tensorflow and NumPy which are written using C and C++. My best guess is that GPT-3 is also written in Python using libraries based on C.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-05-12T02:03:27.380Z
Answers.LastActivityDate: 2021-05-12T02:03:27.380Z
Answers.UserDisplayName: S2673
Body: <p>I know that the API is python based, but what's the gpt-3 engine written in mostly? C? C++? I'm having some trouble finding this info.</p>
  
Tags: <natural-language-processing><programming-languages><c++><gpt-3><c>
Title: What language is the GPT-3 engine written in?
UserDisplayName: Otherness
ThreadText: # What language is the GPT-3 engine written in?
  
  (Asked by: username_0 on 2021-05-12)
  
  I know that the API is python based, but what's the gpt-3 engine written in mostly? C? C++? I'm having some trouble finding this info.
  
  **Tags:** natural-language-processing, programming-languages, c++, gpt-3, c
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2021-05-12. Score: 22 | Accepted answer
  
  The GPT-3 source code hasn’t been released but the creators say it uses the “same model and architecture as GPT-2” [(source)](https://arxiv.org/abs/2005.14165) with some exceptions.
  
  The GPT-2 [source code](https://github.com/openai/gpt-2) is written in 100% Python. The model is based on Tensorflow and NumPy which are written using C and C++. My best guess is that GPT-3 is also written in Python using libraries based on C.
  
  
  ---
  
  