Update README.md
Browse files
README.md
CHANGED
|
@@ -64,4 +64,10 @@ python qlora.py \
|
|
| 64 |
--trust_remote_code \
|
| 65 |
--mpt True \
|
| 66 |
--report_to wandb
|
| 67 |
-
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 64 |
--trust_remote_code \
|
| 65 |
--mpt True \
|
| 66 |
--report_to wandb
|
| 67 |
+
```
|
| 68 |
+
|
| 69 |
+
### Merged model
|
| 70 |
+
|
| 71 |
+
Run the `merge_weights.py` script in the qlora repo: https://github.com/jondurbin/qlora/blob/main/merge_weights.py
|
| 72 |
+
|
| 73 |
+
Then, copy all of the original python files from the mpt-30b repo into your output directory: https://huggingface.co/mosaicml/mpt-30b/tree/main
|