deit-base-patch16-224_rice-leaf-disease-augmented-v4_v5_pft
This model is a fine-tuned version of facebook/deit-base-patch16-224 on an unknown dataset. It achieves the following results on the evaluation set:
- Loss: 0.5294
- Accuracy: 0.8356
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0003
- train_batch_size: 64
- eval_batch_size: 64
- seed: 42
- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: cosine_with_restarts
- lr_scheduler_warmup_steps: 256
- num_epochs: 30
- mixed_precision_training: Native AMP
Training results
Training Loss | Epoch | Step | Validation Loss | Accuracy |
---|---|---|---|---|
2.0319 | 0.5 | 64 | 1.9391 | 0.3020 |
1.8086 | 1.0 | 128 | 1.6836 | 0.4530 |
1.5238 | 1.5 | 192 | 1.4166 | 0.5738 |
1.2924 | 2.0 | 256 | 1.2020 | 0.6510 |
1.1049 | 2.5 | 320 | 1.0590 | 0.6913 |
0.9923 | 3.0 | 384 | 0.9608 | 0.7181 |
0.9115 | 3.5 | 448 | 0.9018 | 0.7450 |
0.8588 | 4.0 | 512 | 0.8649 | 0.7450 |
0.8239 | 4.5 | 576 | 0.8442 | 0.7584 |
0.7945 | 5.0 | 640 | 0.8289 | 0.7584 |
0.7874 | 5.5 | 704 | 0.8279 | 0.7651 |
0.7697 | 6.0 | 768 | 0.8159 | 0.7651 |
0.7888 | 6.5 | 832 | 0.8148 | 0.7685 |
0.7464 | 7.0 | 896 | 0.7960 | 0.7651 |
0.7434 | 7.5 | 960 | 0.7555 | 0.7819 |
0.6914 | 8.0 | 1024 | 0.7372 | 0.7785 |
0.6704 | 8.5 | 1088 | 0.7182 | 0.7886 |
0.6627 | 9.0 | 1152 | 0.7151 | 0.7919 |
0.6469 | 9.5 | 1216 | 0.6991 | 0.7886 |
0.6291 | 10.0 | 1280 | 0.6958 | 0.7886 |
0.6276 | 10.5 | 1344 | 0.6928 | 0.7919 |
0.6253 | 11.0 | 1408 | 0.6923 | 0.7886 |
0.6301 | 11.5 | 1472 | 0.6938 | 0.7852 |
0.608 | 12.0 | 1536 | 0.6624 | 0.7987 |
0.5946 | 12.5 | 1600 | 0.6627 | 0.7852 |
0.5803 | 13.0 | 1664 | 0.6471 | 0.7953 |
0.5637 | 13.5 | 1728 | 0.6368 | 0.8020 |
0.5595 | 14.0 | 1792 | 0.6357 | 0.8020 |
0.5515 | 14.5 | 1856 | 0.6330 | 0.8054 |
0.5417 | 15.0 | 1920 | 0.6282 | 0.8020 |
0.5331 | 15.5 | 1984 | 0.6267 | 0.8020 |
0.5493 | 16.0 | 2048 | 0.6267 | 0.8020 |
0.5486 | 16.5 | 2112 | 0.6191 | 0.8054 |
0.5173 | 17.0 | 2176 | 0.6194 | 0.8020 |
0.517 | 17.5 | 2240 | 0.6128 | 0.8020 |
0.5039 | 18.0 | 2304 | 0.5875 | 0.8188 |
0.4928 | 18.5 | 2368 | 0.5911 | 0.8121 |
0.4952 | 19.0 | 2432 | 0.5872 | 0.8087 |
0.4891 | 19.5 | 2496 | 0.5870 | 0.8054 |
0.4814 | 20.0 | 2560 | 0.5830 | 0.8087 |
0.4829 | 20.5 | 2624 | 0.5826 | 0.8087 |
0.4833 | 21.0 | 2688 | 0.5855 | 0.8121 |
0.4711 | 21.5 | 2752 | 0.5668 | 0.8188 |
0.474 | 22.0 | 2816 | 0.5675 | 0.8020 |
0.4573 | 22.5 | 2880 | 0.5683 | 0.8054 |
0.4545 | 23.0 | 2944 | 0.5546 | 0.8322 |
0.4462 | 23.5 | 3008 | 0.5555 | 0.8188 |
0.4452 | 24.0 | 3072 | 0.5534 | 0.8221 |
0.4483 | 24.5 | 3136 | 0.5519 | 0.8289 |
0.4333 | 25.0 | 3200 | 0.5515 | 0.8289 |
0.4469 | 25.5 | 3264 | 0.5537 | 0.8188 |
0.4321 | 26.0 | 3328 | 0.5420 | 0.8322 |
0.4261 | 26.5 | 3392 | 0.5381 | 0.8255 |
0.4312 | 27.0 | 3456 | 0.5419 | 0.8255 |
0.4239 | 27.5 | 3520 | 0.5322 | 0.8356 |
0.4083 | 28.0 | 3584 | 0.5315 | 0.8389 |
0.4084 | 28.5 | 3648 | 0.5284 | 0.8322 |
0.4102 | 29.0 | 3712 | 0.5284 | 0.8356 |
0.4177 | 29.5 | 3776 | 0.5300 | 0.8356 |
0.3947 | 30.0 | 3840 | 0.5294 | 0.8356 |
Framework versions
- Transformers 4.48.3
- Pytorch 2.5.1+cu124
- Datasets 3.3.2
- Tokenizers 0.21.1
- Downloads last month
- 4
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
Model tree for SodaXII/deit-base-patch16-224_rice-leaf-disease-augmented-v4_v5_pft
Base model
facebook/deit-base-patch16-224