Update README.md
Browse files
README.md
CHANGED
@@ -7,7 +7,7 @@ datasets:
|
|
7 |
## SOLAR-10B-Nector-Orca-DPO-LoRA-Jawade
|
8 |
|
9 |
### Overview
|
10 |
-
This model
|
11 |
|
12 |

|
13 |
|
|
|
7 |
## SOLAR-10B-Nector-Orca-DPO-LoRA-Jawade
|
8 |
|
9 |
### Overview
|
10 |
+
This model is DPO optimized and aligned version of `upstage/SOLAR-10.7B-Instruct-v1.0` model. Trained on a mixture of Berkeley-nest Nectar dataset and Intel DPO Orca dataset using LoRA.
|
11 |
|
12 |

|
13 |
|