Hugging Face's logo

Senthilkumar-M
/
distilbert_finetune_own_data_model

Token Classification
Transformers
TensorBoard
Safetensors
distilbert
Generated from Trainer
Model card Files Metrics Community
Senthil commited on
Commit
30a0a18
·
verified ·
1 Parent(s): 22b818a

End of training

Browse files
Files changed (2) hide show
  1. README.md +15 -35
  2. runs/Mar02_11-05-39_062f85bf131e/events.out.tfevents.1709377731.062f85bf131e.268.3 +3 -0
README.md CHANGED
@@ -20,7 +20,7 @@ should probably proofread and complete it, then remove this comment. -->
20
 
21
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
22
  It achieves the following results on the evaluation set:
23
- - Loss: 0.0053
24
  - Precision: 1.0
25
  - Recall: 1.0
26
  - F1: 1.0
@@ -43,48 +43,28 @@ More information needed
43
  ### Training hyperparameters
44
 
45
  The following hyperparameters were used during training:
46
- - learning_rate: 2e-05
47
- - train_batch_size: 16
48
- - eval_batch_size: 16
49
  - seed: 42
50
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
51
  - lr_scheduler_type: linear
52
- - num_epochs: 30
53
 
54
  ### Training results
55
 
56
  | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
57
  |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
58
- | No log | 1.0 | 3 | 0.8131 | 1.0 | 0.25 | 0.4 | 0.76 |
59
- | No log | 2.0 | 6 | 0.6099 | 1.0 | 0.25 | 0.4 | 0.76 |
60
- | No log | 3.0 | 9 | 0.4666 | 1.0 | 0.25 | 0.4 | 0.76 |
61
- | No log | 4.0 | 12 | 0.3527 | 1.0 | 0.625 | 0.7692 | 0.88 |
62
- | No log | 5.0 | 15 | 0.2583 | 1.0 | 0.875 | 0.9333 | 0.96 |
63
- | No log | 6.0 | 18 | 0.1838 | 1.0 | 1.0 | 1.0 | 1.0 |
64
- | No log | 7.0 | 21 | 0.1230 | 1.0 | 1.0 | 1.0 | 1.0 |
65
- | No log | 8.0 | 24 | 0.0776 | 1.0 | 1.0 | 1.0 | 1.0 |
66
- | No log | 9.0 | 27 | 0.0543 | 1.0 | 1.0 | 1.0 | 1.0 |
67
- | No log | 10.0 | 30 | 0.0427 | 1.0 | 1.0 | 1.0 | 1.0 |
68
- | No log | 11.0 | 33 | 0.0378 | 1.0 | 1.0 | 1.0 | 1.0 |
69
- | No log | 12.0 | 36 | 0.0345 | 1.0 | 1.0 | 1.0 | 1.0 |
70
- | No log | 13.0 | 39 | 0.0323 | 1.0 | 1.0 | 1.0 | 1.0 |
71
- | No log | 14.0 | 42 | 0.0280 | 1.0 | 1.0 | 1.0 | 1.0 |
72
- | No log | 15.0 | 45 | 0.0228 | 1.0 | 1.0 | 1.0 | 1.0 |
73
- | No log | 16.0 | 48 | 0.0180 | 1.0 | 1.0 | 1.0 | 1.0 |
74
- | No log | 17.0 | 51 | 0.0141 | 1.0 | 1.0 | 1.0 | 1.0 |
75
- | No log | 18.0 | 54 | 0.0117 | 1.0 | 1.0 | 1.0 | 1.0 |
76
- | No log | 19.0 | 57 | 0.0104 | 1.0 | 1.0 | 1.0 | 1.0 |
77
- | No log | 20.0 | 60 | 0.0094 | 1.0 | 1.0 | 1.0 | 1.0 |
78
- | No log | 21.0 | 63 | 0.0086 | 1.0 | 1.0 | 1.0 | 1.0 |
79
- | No log | 22.0 | 66 | 0.0079 | 1.0 | 1.0 | 1.0 | 1.0 |
80
- | No log | 23.0 | 69 | 0.0074 | 1.0 | 1.0 | 1.0 | 1.0 |
81
- | No log | 24.0 | 72 | 0.0069 | 1.0 | 1.0 | 1.0 | 1.0 |
82
- | No log | 25.0 | 75 | 0.0063 | 1.0 | 1.0 | 1.0 | 1.0 |
83
- | No log | 26.0 | 78 | 0.0059 | 1.0 | 1.0 | 1.0 | 1.0 |
84
- | No log | 27.0 | 81 | 0.0056 | 1.0 | 1.0 | 1.0 | 1.0 |
85
- | No log | 28.0 | 84 | 0.0054 | 1.0 | 1.0 | 1.0 | 1.0 |
86
- | No log | 29.0 | 87 | 0.0053 | 1.0 | 1.0 | 1.0 | 1.0 |
87
- | No log | 30.0 | 90 | 0.0053 | 1.0 | 1.0 | 1.0 | 1.0 |
88
 
89
 
90
  ### Framework versions
 
20
 
21
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
22
  It achieves the following results on the evaluation set:
23
+ - Loss: 0.0045
24
  - Precision: 1.0
25
  - Recall: 1.0
26
  - F1: 1.0
 
43
  ### Training hyperparameters
44
 
45
  The following hyperparameters were used during training:
46
+ - learning_rate: 5e-05
47
+ - train_batch_size: 8
48
+ - eval_batch_size: 8
49
  - seed: 42
50
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
51
  - lr_scheduler_type: linear
52
+ - num_epochs: 10
53
 
54
  ### Training results
55
 
56
  | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
57
  |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
58
+ | No log | 1.0 | 5 | 0.3497 | 1.0 | 0.625 | 0.7692 | 0.88 |
59
+ | No log | 2.0 | 10 | 0.1157 | 1.0 | 1.0 | 1.0 | 1.0 |
60
+ | No log | 3.0 | 15 | 0.0402 | 1.0 | 1.0 | 1.0 | 1.0 |
61
+ | No log | 4.0 | 20 | 0.0331 | 1.0 | 1.0 | 1.0 | 1.0 |
62
+ | No log | 5.0 | 25 | 0.0189 | 1.0 | 1.0 | 1.0 | 1.0 |
63
+ | No log | 6.0 | 30 | 0.0108 | 1.0 | 1.0 | 1.0 | 1.0 |
64
+ | No log | 7.0 | 35 | 0.0070 | 1.0 | 1.0 | 1.0 | 1.0 |
65
+ | No log | 8.0 | 40 | 0.0054 | 1.0 | 1.0 | 1.0 | 1.0 |
66
+ | No log | 9.0 | 45 | 0.0047 | 1.0 | 1.0 | 1.0 | 1.0 |
67
+ | No log | 10.0 | 50 | 0.0045 | 1.0 | 1.0 | 1.0 | 1.0 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
68
 
69
 
70
  ### Framework versions
runs/Mar02_11-05-39_062f85bf131e/events.out.tfevents.1709377731.062f85bf131e.268.3 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ea8c80a0ed9de686d216bd084b57d64ef015d39f02b67c7662fdd188261b7510
3
+ size 551