End of training
Browse files- README.md +3 -3
- generation_config.json +1 -1
README.md
CHANGED
@@ -43,7 +43,7 @@ The following hyperparameters were used during training:
|
|
43 |
- seed: 42
|
44 |
- gradient_accumulation_steps: 16
|
45 |
- total_train_batch_size: 128
|
46 |
-
- optimizer:
|
47 |
- lr_scheduler_type: linear
|
48 |
- lr_scheduler_warmup_steps: 200
|
49 |
- num_epochs: 1
|
@@ -54,7 +54,7 @@ The following hyperparameters were used during training:
|
|
54 |
|
55 |
### Framework versions
|
56 |
|
57 |
-
- Transformers 4.
|
58 |
- Pytorch 2.5.1+cu124
|
59 |
- Datasets 2.19.2
|
60 |
-
- Tokenizers 0.
|
|
|
43 |
- seed: 42
|
44 |
- gradient_accumulation_steps: 16
|
45 |
- total_train_batch_size: 128
|
46 |
+
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
47 |
- lr_scheduler_type: linear
|
48 |
- lr_scheduler_warmup_steps: 200
|
49 |
- num_epochs: 1
|
|
|
54 |
|
55 |
### Framework versions
|
56 |
|
57 |
+
- Transformers 4.45.0
|
58 |
- Pytorch 2.5.1+cu124
|
59 |
- Datasets 2.19.2
|
60 |
+
- Tokenizers 0.20.3
|
generation_config.json
CHANGED
@@ -2,5 +2,5 @@
|
|
2 |
"_from_model_config": true,
|
3 |
"bos_token_id": 32013,
|
4 |
"eos_token_id": 32014,
|
5 |
-
"transformers_version": "4.
|
6 |
}
|
|
|
2 |
"_from_model_config": true,
|
3 |
"bos_token_id": 32013,
|
4 |
"eos_token_id": 32014,
|
5 |
+
"transformers_version": "4.45.0"
|
6 |
}
|