 Training hyperparameters  The following hyperparameters were used during training: - learning_rate: 1e-05 - train_batch_size: 10 - eval_batch_size: 16 - gradient_accumulation_steps: 4 - optimizer: AdamW with betas=(None, None), weight_decay=None and epsilon=None - lr_scheduler: constant - lr_warmup_steps: 0 - ema_inv_gamma: None - ema_inv_gamma: None - ema_inv_gamma: None - mixed_precision: fp16  