Question About The Method
#1
by
GreenRed
- opened
Did you use the QLoRA or LoRA,if yes,did you mix the parameter with the origin parameter?
Yes, we use QLoRA, and merge the LoRA model into the origin model like below:
model = PeftModel.from_pretrained(base_model, peft_model_path)
model = model.merge_and_unload()
model.save_pretrained(merged_model_name_or_path)
tokenizer.save_pretrained(merged_model_name_or_path)
Thank U !
Will U please upgrade the value of metric or some other metrics about the new model,I am grateful to know whether the model can work better with the long input?
besides,I wonder if I can know the format that you use to combine the input and output