msimpo-30each-v31
Browse files
README.md
CHANGED
|
@@ -1,6 +1,6 @@
|
|
| 1 |
---
|
| 2 |
base_model: meta-llama/Meta-Llama-3.1-8B-Instruct
|
| 3 |
-
library_name:
|
| 4 |
model_name: msimpo-30each-v31
|
| 5 |
tags:
|
| 6 |
- generated_from_trainer
|
|
@@ -34,7 +34,6 @@ This model was trained with CPO, a method introduced in [Contrastive Preference
|
|
| 34 |
|
| 35 |
### Framework versions
|
| 36 |
|
| 37 |
-
- PEFT 0.14.0
|
| 38 |
- TRL: 0.15.0.dev0
|
| 39 |
- Transformers: 4.48.2
|
| 40 |
- Pytorch: 2.2.0+cu118
|
|
|
|
| 1 |
---
|
| 2 |
base_model: meta-llama/Meta-Llama-3.1-8B-Instruct
|
| 3 |
+
library_name: transformers
|
| 4 |
model_name: msimpo-30each-v31
|
| 5 |
tags:
|
| 6 |
- generated_from_trainer
|
|
|
|
| 34 |
|
| 35 |
### Framework versions
|
| 36 |
|
|
|
|
| 37 |
- TRL: 0.15.0.dev0
|
| 38 |
- Transformers: 4.48.2
|
| 39 |
- Pytorch: 2.2.0+cu118
|