Update README.md

README.md

@@ -51,6 +51,9 @@ For best results, one should use the prompt format used during training:
 prompt = "prompter: <prompt_1> assistant: <response_1> prompter: <prompt_2> ..."
 ```
 
+Please use a version of peft where [#755](https://github.com/huggingface/peft/pull/755) has been merged to make sure the model is loaded correctly. You can install `peft` with `pip install git+https://github.com/huggingface/peft.git` to make sure this is the case.
+
+
 ## Intended uses & limitations
 
 Since the model was trained on oasst1 data, the reward will reflect any biases present in the oasst1 data.