End of training

README.md

@@ -34,13 +34,13 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 1e-05
-- train_batch_size: 4
+- learning_rate: 0.03072
+- train_batch_size: 1
 - eval_batch_size: 8
 - seed: 42
 - distributed_type: multi-GPU
 - num_devices: 4
-- total_train_batch_size: 16
+- total_train_batch_size: 4
 - total_eval_batch_size: 32
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
@@ -54,5 +54,5 @@ The following hyperparameters were used during training:
 
 - Transformers 4.44.0
 - Pytorch 2.3.1
-- Datasets 3.1.0
+- Datasets 3.2.0
 - Tokenizers 0.19.1

model-00001-of-00003.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e0bae547c969129977a99105f6e42d3cccf9c3ccb5529435075a9aa4dd263de0
+oid sha256:2982ff3232ec17bfcefb41f01738f4c33e30ba7220f764448feefd18b8c22129
 size 4977795456

model-00002-of-00003.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:70a93a2a8883135b1993aa00ed320f9118cf6e8c51e128990231ce155f0a717e
+oid sha256:926cb9b70a012b535b8310757e9e1e8aaa40acf9455ae1007bedd10d4d3844a0
 size 4967384136

model-00003-of-00003.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4405b6dce75af74912799b304650f986a6dd0274730b0b515cba61d3d9186fdf
+oid sha256:a9ed81e183b954fbf38bb59d885792207b5d528747b23a57f9c726caa6ca234b
 size 3769470736

tokenizer.json

@@ -2,7 +2,7 @@
   "version": "1.0",
   "truncation": {
     "direction": "Right",
-    "max_length": 512,
+    "max_length": 2048,
     "strategy": "LongestFirst",
     "stride": 0
   },

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e9f8767a6c3472bc696186cf46a552f2b9a5d3ef82a676aa7a9ad6579938731f
+oid sha256:0f6738a1570af40e041183c27865f46a698e839b06786739c8c487e9f461d814
 size 6840