You probably don’t need to fine-tune an LLM
RAG sucks. Microsoft is the force behind it because they don't allow training on their chatgpt models.Fine-tuning even Lora on the open source models is nearly always better than these other approaches