Answers.Body: <p>I'm not familiar with that specific demo, but RAG usually works by adding retrieved documents directly into the LLM context. You should assume the process would result in documents being sent in text form to OpenAI.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-10-13T20:26:14.380Z
Answers.LastActivityDate: 2023-10-13T20:26:14.380Z
Answers.UserDisplayName: Karl
Body: <p>I understand in RAG, documents are sent (perhaps in embedded form?) to an LLM.
  Supposing one uses openAI as in <a href="https://github.com/Azure-Samples/azure-search-openai-demo" rel="nofollow noreferrer">this popular demo</a>, would it send my data to them, thus with a potential data privacy risk?</p>
  <p><a href="https://i.sstatic.net/hLWix.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/hLWix.png" alt="enter image description here" /></a>
  (source: <a href="https://blog.ml6.eu/leveraging-llms-on-your-domain-specific-knowledge-base-4441c8837b47" rel="nofollow noreferrer">ML6</a>)</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2023-10-16T00:48:21.640Z
Comments.Text: Are documents sent in embedded form in your setting? If the text itself gets sent then, yes, it could be a privacy risk. If they're sent in an embedded form, then that's a more complicated question.
Comments.UserDisplayName: Alexander Wan
Tags: <open-ai>
Title: Does retriever-augmented generation enable the LLM to violate my data privacy?
UserDisplayName: PDiracDelta
ThreadText: # Does retriever-augmented generation enable the LLM to violate my data privacy?
  
  (Asked by: username_0 on 2023-10-13)
  
  I understand in RAG, documents are sent (perhaps in embedded form?) to an LLM.
  Supposing one uses openAI as in [this popular demo](https://github.com/Azure-Samples/azure-search-openai-demo), would it send my data to them, thus with a potential data privacy risk?
  
  [![enter image description here](https://i.sstatic.net/hLWix.png)](https://i.sstatic.net/hLWix.png)
  (source: [ML6](https://blog.ml6.eu/leveraging-llms-on-your-domain-specific-knowledge-base-4441c8837b47))
  
  **Tags:** open-ai
  > **Comments:**
  > **username_1**: Are documents sent in embedded form in your setting? If the text itself gets sent then, yes, it could be a privacy risk. If they're sent in an embedded form, then that's a more complicated question.  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_2 on 2023-10-13. Score: 1
  
  I'm not familiar with that specific demo, but RAG usually works by adding retrieved documents directly into the LLM context. You should assume the process would result in documents being sent in text form to OpenAI.
  
  
  ---
  
  