Answers.Body: <p>Yes it is possible. This is a popular use-case these days. check out <a href="https://github.com/imartinez/privateGPT" rel="nofollow noreferrer">privateGPT</a>.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-07-07T16:04:48.510Z
Answers.LastActivityDate: 2023-07-07T16:04:48.510Z
Answers.UserDisplayName: morpheus
Answers.Body: <p>You can run open source models locally without sharing your data to any server. Nowadays to perform well you need to use GPUs for efficient running of te queries, either locally or on private clouds. You may prefer services that provide private instances of large models such as GPT / Claude (available on Azure / AWS) or use smaller models with e.g. RAG to optimize the results for your domain and data.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2024-03-17T13:36:53.817Z
Answers.LastActivityDate: 2024-03-17T13:36:53.817Z
Answers.UserDisplayName: rkellerm
Body: <p>We have a lot of internal documentation that contains sensitive information.</p>
  <p>Is it possible to have a ChatGPT bot that can answer questions about this information, to my used by users with clearance for this information, without posting the information to external servers?</p>
  <p>I can find documentation on <code>embeddings</code>, but these seem to require posting info to OpenAI for it to be processed and stored there.</p>
  
Tags: <chat-bots><chatgpt><ai-security>
Title: Is it possible to have a ChatGPT bot that can answer questions about sensitive information without using external servers?
UserDisplayName: BanksySan
ThreadText: # Is it possible to have a ChatGPT bot that can answer questions about sensitive information without using external servers?
  
  (Asked by: username_0 on 2023-07-07)
  
  We have a lot of internal documentation that contains sensitive information.
  
  Is it possible to have a ChatGPT bot that can answer questions about this information, to my used by users with clearance for this information, without posting the information to external servers?
  
  I can find documentation on `embeddings`, but these seem to require posting info to OpenAI for it to be processed and stored there.
  
  **Tags:** chat-bots, chatgpt, ai-security
  
  
  ---
  
  ## 2 answers
  
  ### Answer by username_1 on 2023-07-07. Score: 4
  
  Yes it is possible. This is a popular use-case these days. check out [privateGPT](https://github.com/imartinez/privateGPT).
  
  
  ---
  
  ### Answer by username_2 on 2024-03-17. Score: 0
  
  You can run open source models locally without sharing your data to any server. Nowadays to perform well you need to use GPUs for efficient running of te queries, either locally or on private clouds. You may prefer services that provide private instances of large models such as GPT / Claude (available on Azure / AWS) or use smaller models with e.g. RAG to optimize the results for your domain and data.
  
  
  ---
  
  