Answers.Body: <p>I am completing a master's degree in artificial intelligence.I am researching this field. Initially, try training using techniques like QLora, which was released this week. test distillation techniques and also try fine-tuning. Afterwards, you will need to add a control extern. From my perspective, they could have a model observing the conversation, similar to how ChatGPT functions, or they could use keyword analysis with a smaller model.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-05-29T09:57:04.320Z
Answers.LastActivityDate: 2023-05-29T09:57:04.320Z
Answers.UserDisplayName: Alicia Colmenero-Fernandez
Body: <p>We have a dataset of legal cases, academic papers etc which we will load into a vector database. We want to develop an agent that will allow a user to enter a specific legal issue, the agent then will search for all related documents (or portions of documents) and provide the user with a summary of each along with the citation. The responses should only be based on our domain.
  Can this be done with prompt engineering? Would fine-tuning help the quality of the responses? Anything else I should be investigating? TIA</p>
  
Tags: <fine-tuning><prompt>
Title: Fine-tuning or Prompt Engineering or both?
UserDisplayName: GEM
ThreadText: # Fine-tuning or Prompt Engineering or both?
  
  (Asked by: username_0 on 2023-05-29)
  
  We have a dataset of legal cases, academic papers etc which we will load into a vector database. We want to develop an agent that will allow a user to enter a specific legal issue, the agent then will search for all related documents (or portions of documents) and provide the user with a summary of each along with the citation. The responses should only be based on our domain.
  Can this be done with prompt engineering? Would fine-tuning help the quality of the responses? Anything else I should be investigating? TIA
  
  **Tags:** fine-tuning, prompt
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2023-05-29. Score: 1
  
  I am completing a master's degree in artificial intelligence.I am researching this field. Initially, try training using techniques like QLora, which was released this week. test distillation techniques and also try fine-tuning. Afterwards, you will need to add a control extern. From my perspective, they could have a model observing the conversation, similar to how ChatGPT functions, or they could use keyword analysis with a smaller model.
  
  
  ---
  
  