Training in progress, epoch 5

README.md

@@ -32,15 +32,13 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 0.001
-- train_batch_size: 20
-- eval_batch_size: 20
+- learning_rate: 2e-05
+- train_batch_size: 32
+- eval_batch_size: 32
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.95) and epsilon=1e-08
-- lr_scheduler_type: constant
-- lr_scheduler_warmup_steps: 5
-- num_epochs: 1
-- mixed_precision_training: Native AMP
+- lr_scheduler_type: cosine_with_restarts
+- num_epochs: 5
 
 ### Framework versions
 

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c79ddb82896336544a9ecb900d05d56eedf218074683a2767edc9cec62bef163
+oid sha256:c65e69699a42e48322561c81f3b42b8744b5bb6e73515ceeca26bbf7b39ddab9
 size 80013120