Fine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Custom Models
Just to add to this, I run through a lot of these topics around fine-tuning Llama 2 on your own dataset (for me it's my own code :P) in a coding live stream a couple weeks ago. All on Colab single GPUFine-tuning Llama stream: https://www.youtube.com/watch?v=TYgtG2Th6fI&t=2282sI have a couple more one where I do a QLoRa fine tuning session and explain the concepts as a personally self taught engineer (software engineer of 8 years moving into ML recently)QloRa fine-tuning stream: https://www.youtube.com/watch?v=LitybCiLhSc&t=4584sOverall I'm trying to breakdown how I'm approaching a lot of my personal projects and my current AI driven startup. Want to make this information as accessible as possible. Also have a series where I'm fine-tuning a model to be the smallest webdev llm as possible which seems like people are liking. Only been streaming for about a month and plenty more to come.Ask me any question about the stream and fine-tuning llama!