 Fine-tuning
 
 The model was finetuned on GeForce GTX 960M for 5 hours. The parameters are:
 
 |      Parameter      | Value | 
 |:-------------------:|:-----:|
 |    Learning rate    | 5e-5  | 
 |    Weight decay     | 0.01  | 
 | Training batch size |   4   | 
 |       Epochs        |   3   | 
 
 Here is the scores during the training:
 
 |   Epoch    | Training Loss | 	 Validation Loss | 	 Accuracy |   	 F1    | 	 Precision | 	 Recall  |
 |:----------:|:-------------:|:-----------------:|:----------:|:---------:|:-----------:|:---------:|
 |     1      |   0.008300    |     	0.005783     | 	0.998330  | 	0.998252 |  	0.996511  | 	1.000000 |
 |     2      |   0.000000    |     	0.000161     | 	0.999889  | 	0.999883 |  	0.999767  | 	1.000000 |
 |     3      |   0.000000    |     	0.000122     | 	0.999889  | 	0.999883 |  	0.999767  | 	1.000000 |
 
 