JayHyeon commited on
Commit
b9a916b
·
verified ·
1 Parent(s): 300ea23

Model save

Browse files
Files changed (1) hide show
  1. README.md +3 -4
README.md CHANGED
@@ -1,6 +1,5 @@
1
  ---
2
- base_model: JayHyeon/Qwen2.5-0.5B_ultrainteract_sft_2e-5_1ep
3
- datasets: JayHyeon/trl_ultrainteract-pair
4
  library_name: transformers
5
  model_name: Qwen_0.5-ultrainteract_BDPO_5e-7-1ep_0.5bdpo_lambda
6
  tags:
@@ -12,7 +11,7 @@ licence: license
12
 
13
  # Model Card for Qwen_0.5-ultrainteract_BDPO_5e-7-1ep_0.5bdpo_lambda
14
 
15
- This model is a fine-tuned version of [JayHyeon/Qwen2.5-0.5B_ultrainteract_sft_2e-5_1ep](https://huggingface.co/JayHyeon/Qwen2.5-0.5B_ultrainteract_sft_2e-5_1ep) on the [JayHyeon/trl_ultrainteract-pair](https://huggingface.co/datasets/JayHyeon/trl_ultrainteract-pair) dataset.
16
  It has been trained using [TRL](https://github.com/huggingface/trl).
17
 
18
  ## Quick start
@@ -28,7 +27,7 @@ print(output["generated_text"])
28
 
29
  ## Training procedure
30
 
31
- [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/bonin147/huggingface/runs/f5n9yktr)
32
 
33
 
34
  This model was trained with DPO, a method introduced in [Direct Preference Optimization: Your Language Model is Secretly a Reward Model](https://huggingface.co/papers/2305.18290).
 
1
  ---
2
+ base_model: JayHyeon/Qwen2.5-0.5B-SFT-2e-5-2ep
 
3
  library_name: transformers
4
  model_name: Qwen_0.5-ultrainteract_BDPO_5e-7-1ep_0.5bdpo_lambda
5
  tags:
 
11
 
12
  # Model Card for Qwen_0.5-ultrainteract_BDPO_5e-7-1ep_0.5bdpo_lambda
13
 
14
+ This model is a fine-tuned version of [JayHyeon/Qwen2.5-0.5B-SFT-2e-5-2ep](https://huggingface.co/JayHyeon/Qwen2.5-0.5B-SFT-2e-5-2ep).
15
  It has been trained using [TRL](https://github.com/huggingface/trl).
16
 
17
  ## Quick start
 
27
 
28
  ## Training procedure
29
 
30
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/bonin147/huggingface/runs/jd8xbeby)
31
 
32
 
33
  This model was trained with DPO, a method introduced in [Direct Preference Optimization: Your Language Model is Secretly a Reward Model](https://huggingface.co/papers/2305.18290).