How to merge lora?
#1
by
heatball
- opened
Please give the code to merge the lora. I can't find it anywhere.
@drunkOnData Oh https://github.com/unslothai/unsloth/wiki#saving-models-to-16bit-for-vllm
Also our Colab notebook for Mistral at the bottom has some merging code :) https://colab.research.google.com/drive/1Dyauq4kTZoLewQ1cApceUQVNcnnNTzg_?usp=sharing
Thank you!!! You da best 😊
heatball
changed discussion status to
closed
@drunkOnData no problems!