jeromeramos commited on
Commit
ee9f722
·
verified ·
1 Parent(s): fccb816

End of training

Browse files
Files changed (2) hide show
  1. README.md +5 -3
  2. config.json +1 -1
README.md CHANGED
@@ -1,7 +1,9 @@
1
  ---
2
  base_model: Sim4Rec/inter-play-sim-assistant-sft
 
 
3
  library_name: transformers
4
- model_name: inter-play-sim-assistant-dpo
5
  tags:
6
  - generated_from_trainer
7
  - trl
@@ -9,9 +11,9 @@ tags:
9
  licence: license
10
  ---
11
 
12
- # Model Card for inter-play-sim-assistant-dpo
13
 
14
- This model is a fine-tuned version of [Sim4Rec/inter-play-sim-assistant-sft](https://huggingface.co/Sim4Rec/inter-play-sim-assistant-sft).
15
  It has been trained using [TRL](https://github.com/huggingface/trl).
16
 
17
  ## Quick start
 
1
  ---
2
  base_model: Sim4Rec/inter-play-sim-assistant-sft
3
+ datasets:
4
+ - Sim4Rec/dpo_data
5
  library_name: transformers
6
+ model_name: Sim4Rec/inter-play-sim-assistant-sft
7
  tags:
8
  - generated_from_trainer
9
  - trl
 
11
  licence: license
12
  ---
13
 
14
+ # Model Card for Sim4Rec/inter-play-sim-assistant-sft
15
 
16
+ This model is a fine-tuned version of [Sim4Rec/inter-play-sim-assistant-sft](https://huggingface.co/Sim4Rec/inter-play-sim-assistant-sft) on the [['Sim4Rec/dpo_data']](https://huggingface.co/datasets/['Sim4Rec/dpo_data']) dataset.
17
  It has been trained using [TRL](https://github.com/huggingface/trl).
18
 
19
  ## Quick start
config.json CHANGED
@@ -32,6 +32,6 @@
32
  "tie_word_embeddings": false,
33
  "torch_dtype": "bfloat16",
34
  "transformers_version": "4.48.2",
35
- "use_cache": false,
36
  "vocab_size": 128320
37
  }
 
32
  "tie_word_embeddings": false,
33
  "torch_dtype": "bfloat16",
34
  "transformers_version": "4.48.2",
35
+ "use_cache": true,
36
  "vocab_size": 128320
37
  }