[Loading model issue] Lack of config.json
Can not load the model.
When I want to load the model following your example code, it returns the following error:ValueError: Unrecognized model in UW-Madison-Lee-Lab/VersaPRM. Should have a model_type key in its config.json
I found "config.json" is in ".no_exist" folder, and the file is empty.
Hi, not sure if you were able to solve this. But I believe the issue might be because you are missing the peft package. First installing the package via
pip install peft
should do the trick.
Thank you for your solution! After installing the peft package, I could load the model directly!
Also, I tried first to load the base model and then apply the adapter using:
model = AutoModelForCausalLM.from_pretrained('UW-Madison-Lee-Lab/Llama-PRM800K')
model.load_adapter('UW-Madison-Lee-Lab/VersaPRM')
Although this can load the model, I was unsure whether the models loaded by the two patterns are the same.
Now I can figure out that these two patterns produce the same final model.
Thank you again for your help and for taking the time to respond!