MohamedRashad commited on
Commit
004978d
1 Parent(s): 42fab36

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -3
README.md CHANGED
@@ -16,11 +16,10 @@ pipeline_tag: text-generation
16
 
17
  ## Story first
18
 
19
- This model is the a finetuned version of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) using [ORPO](https://github.com/xfactlab/orpo).
20
 
21
- I wanted to try ORPO and see if it will better align a biased English model to the arabic language or not.
22
 
23
- **Llama-3** is heavily biased to the English language in all of its responses (in default state) but this finetune has changed this a bit.
24
 
25
  ## Evaluation and Results
26
 
 
16
 
17
  ## Story first
18
 
19
+ This model is the a finetuned version of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) using [ORPO](https://github.com/xfactlab/orpo) on [2A2I/argilla-dpo-mix-7k-arabic](https://huggingface.co/datasets/2A2I/argilla-dpo-mix-7k-arabic).
20
 
21
+ I wanted to try ORPO and see if it will better align a biased English model like llama3 to the arabic language or not and the result is interesting.
22
 
 
23
 
24
  ## Evaluation and Results
25