MohamedRashad
commited on
Commit
•
004978d
1
Parent(s):
42fab36
Update README.md
Browse files
README.md
CHANGED
@@ -16,11 +16,10 @@ pipeline_tag: text-generation
|
|
16 |
|
17 |
## Story first
|
18 |
|
19 |
-
This model is the a finetuned version of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) using [ORPO](https://github.com/xfactlab/orpo).
|
20 |
|
21 |
-
I wanted to try ORPO and see if it will better align a biased English model to the arabic language or not.
|
22 |
|
23 |
-
**Llama-3** is heavily biased to the English language in all of its responses (in default state) but this finetune has changed this a bit.
|
24 |
|
25 |
## Evaluation and Results
|
26 |
|
|
|
16 |
|
17 |
## Story first
|
18 |
|
19 |
+
This model is the a finetuned version of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) using [ORPO](https://github.com/xfactlab/orpo) on [2A2I/argilla-dpo-mix-7k-arabic](https://huggingface.co/datasets/2A2I/argilla-dpo-mix-7k-arabic).
|
20 |
|
21 |
+
I wanted to try ORPO and see if it will better align a biased English model like llama3 to the arabic language or not and the result is interesting.
|
22 |
|
|
|
23 |
|
24 |
## Evaluation and Results
|
25 |
|