Hugging Face's logo

Senthilkumar-M
/
distilbert_finetune_own_data_model

Token Classification
Transformers
TensorBoard
Safetensors
distilbert
Generated from Trainer
Model card Files Metrics Community
Senthil commited on
Commit
6f863b3
·
verified ·
1 Parent(s): cbc8d0d

End of training

Browse files
Files changed (6) hide show
  1. README.md +55 -55
  2. config.json +4 -2
  3. model.safetensors +2 -2
  4. runs/Feb29_07-34-27_9879f2213cb5/events.out.tfevents.1709192082.9879f2213cb5.492.2 +3 -0
  5. runs/Feb29_07-34-27_9879f2213cb5/events.out.tfevents.1709192291.9879f2213cb5.492.3 +3 -0
  6. training_args.bin +1 -1
README.md CHANGED
@@ -20,11 +20,11 @@ should probably proofread and complete it, then remove this comment. -->
20
 
21
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
22
  It achieves the following results on the evaluation set:
23
- - Loss: 0.2390
24
- - Precision: 0.7576
25
- - Recall: 0.6410
26
- - F1: 0.6944
27
- - Accuracy: 0.8966
28
 
29
  ## Model description
30
 
@@ -55,56 +55,56 @@ The following hyperparameters were used during training:
55
 
56
  | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
57
  |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
58
- | No log | 1.0 | 1 | 0.6390 | 0.0 | 0.0 | 0.0 | 0.6404 |
59
- | No log | 2.0 | 2 | 0.6159 | 0.0 | 0.0 | 0.0 | 0.6404 |
60
- | No log | 3.0 | 3 | 0.5974 | 0.0 | 0.0 | 0.0 | 0.6453 |
61
- | No log | 4.0 | 4 | 0.5803 | 0.0 | 0.0 | 0.0 | 0.6453 |
62
- | No log | 5.0 | 5 | 0.5629 | 0.0 | 0.0 | 0.0 | 0.6453 |
63
- | No log | 6.0 | 6 | 0.5440 | 0.0 | 0.0 | 0.0 | 0.6502 |
64
- | No log | 7.0 | 7 | 0.5235 | 0.6667 | 0.0513 | 0.0952 | 0.6700 |
65
- | No log | 8.0 | 8 | 0.5020 | 0.6667 | 0.0513 | 0.0952 | 0.6749 |
66
- | No log | 9.0 | 9 | 0.4791 | 0.5 | 0.0513 | 0.0930 | 0.6798 |
67
- | No log | 10.0 | 10 | 0.4557 | 0.5556 | 0.1282 | 0.2083 | 0.7044 |
68
- | No log | 11.0 | 11 | 0.4327 | 0.5833 | 0.1795 | 0.2745 | 0.7291 |
69
- | No log | 12.0 | 12 | 0.4097 | 0.5 | 0.2051 | 0.2909 | 0.7537 |
70
- | No log | 13.0 | 13 | 0.3872 | 0.5882 | 0.2564 | 0.3571 | 0.7635 |
71
- | No log | 14.0 | 14 | 0.3666 | 0.7059 | 0.3077 | 0.4286 | 0.7734 |
72
- | No log | 15.0 | 15 | 0.3478 | 0.6667 | 0.3590 | 0.4667 | 0.7980 |
73
- | No log | 16.0 | 16 | 0.3316 | 0.7391 | 0.4359 | 0.5484 | 0.8177 |
74
- | No log | 17.0 | 17 | 0.3179 | 0.7308 | 0.4872 | 0.5846 | 0.8325 |
75
- | No log | 18.0 | 18 | 0.3062 | 0.7037 | 0.4872 | 0.5758 | 0.8374 |
76
- | No log | 19.0 | 19 | 0.2958 | 0.75 | 0.5385 | 0.6269 | 0.8473 |
77
- | No log | 20.0 | 20 | 0.2868 | 0.7931 | 0.5897 | 0.6765 | 0.8621 |
78
- | No log | 21.0 | 21 | 0.2791 | 0.8276 | 0.6154 | 0.7059 | 0.8670 |
79
- | No log | 22.0 | 22 | 0.2727 | 0.8276 | 0.6154 | 0.7059 | 0.8670 |
80
- | No log | 23.0 | 23 | 0.2672 | 0.8333 | 0.6410 | 0.7246 | 0.8768 |
81
- | No log | 24.0 | 24 | 0.2625 | 0.7812 | 0.6410 | 0.7042 | 0.8867 |
82
- | No log | 25.0 | 25 | 0.2586 | 0.7812 | 0.6410 | 0.7042 | 0.8867 |
83
- | No log | 26.0 | 26 | 0.2553 | 0.7812 | 0.6410 | 0.7042 | 0.8867 |
84
- | No log | 27.0 | 27 | 0.2527 | 0.7812 | 0.6410 | 0.7042 | 0.8916 |
85
- | No log | 28.0 | 28 | 0.2505 | 0.7812 | 0.6410 | 0.7042 | 0.8916 |
86
- | No log | 29.0 | 29 | 0.2487 | 0.7812 | 0.6410 | 0.7042 | 0.8916 |
87
- | No log | 30.0 | 30 | 0.2472 | 0.7812 | 0.6410 | 0.7042 | 0.8916 |
88
- | No log | 31.0 | 31 | 0.2459 | 0.7812 | 0.6410 | 0.7042 | 0.8916 |
89
- | No log | 32.0 | 32 | 0.2448 | 0.7812 | 0.6410 | 0.7042 | 0.8916 |
90
- | No log | 33.0 | 33 | 0.2439 | 0.7812 | 0.6410 | 0.7042 | 0.8916 |
91
- | No log | 34.0 | 34 | 0.2431 | 0.7812 | 0.6410 | 0.7042 | 0.8916 |
92
- | No log | 35.0 | 35 | 0.2425 | 0.7812 | 0.6410 | 0.7042 | 0.8916 |
93
- | No log | 36.0 | 36 | 0.2419 | 0.7812 | 0.6410 | 0.7042 | 0.8916 |
94
- | No log | 37.0 | 37 | 0.2413 | 0.7576 | 0.6410 | 0.6944 | 0.8966 |
95
- | No log | 38.0 | 38 | 0.2409 | 0.7576 | 0.6410 | 0.6944 | 0.8966 |
96
- | No log | 39.0 | 39 | 0.2405 | 0.7576 | 0.6410 | 0.6944 | 0.8966 |
97
- | No log | 40.0 | 40 | 0.2402 | 0.7576 | 0.6410 | 0.6944 | 0.8966 |
98
- | No log | 41.0 | 41 | 0.2400 | 0.7576 | 0.6410 | 0.6944 | 0.8966 |
99
- | No log | 42.0 | 42 | 0.2398 | 0.7576 | 0.6410 | 0.6944 | 0.8966 |
100
- | No log | 43.0 | 43 | 0.2396 | 0.7576 | 0.6410 | 0.6944 | 0.8966 |
101
- | No log | 44.0 | 44 | 0.2394 | 0.7576 | 0.6410 | 0.6944 | 0.8966 |
102
- | No log | 45.0 | 45 | 0.2393 | 0.7576 | 0.6410 | 0.6944 | 0.8966 |
103
- | No log | 46.0 | 46 | 0.2392 | 0.7576 | 0.6410 | 0.6944 | 0.8966 |
104
- | No log | 47.0 | 47 | 0.2391 | 0.7576 | 0.6410 | 0.6944 | 0.8966 |
105
- | No log | 48.0 | 48 | 0.2390 | 0.7576 | 0.6410 | 0.6944 | 0.8966 |
106
- | No log | 49.0 | 49 | 0.2390 | 0.7576 | 0.6410 | 0.6944 | 0.8966 |
107
- | No log | 50.0 | 50 | 0.2390 | 0.7576 | 0.6410 | 0.6944 | 0.8966 |
108
 
109
 
110
  ### Framework versions
 
20
 
21
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
22
  It achieves the following results on the evaluation set:
23
+ - Loss: 0.0907
24
+ - Precision: 0.4286
25
+ - Recall: 0.6
26
+ - F1: 0.5
27
+ - Accuracy: 0.92
28
 
29
  ## Model description
30
 
 
55
 
56
  | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
57
  |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
58
+ | No log | 1.0 | 3 | 0.8542 | 0.0 | 0.0 | 0.0 | 0.6 |
59
+ | No log | 2.0 | 6 | 0.7877 | 0.0 | 0.0 | 0.0 | 0.6 |
60
+ | No log | 3.0 | 9 | 0.7607 | 0.0 | 0.0 | 0.0 | 0.68 |
61
+ | No log | 4.0 | 12 | 0.7105 | 0.0 | 0.0 | 0.0 | 0.8 |
62
+ | No log | 5.0 | 15 | 0.6518 | 0.0 | 0.0 | 0.0 | 0.8 |
63
+ | No log | 6.0 | 18 | 0.6048 | 0.0 | 0.0 | 0.0 | 0.8 |
64
+ | No log | 7.0 | 21 | 0.5669 | 0.0 | 0.0 | 0.0 | 0.8 |
65
+ | No log | 8.0 | 24 | 0.5373 | 0.0 | 0.0 | 0.0 | 0.8 |
66
+ | No log | 9.0 | 27 | 0.4927 | 0.0 | 0.0 | 0.0 | 0.8 |
67
+ | No log | 10.0 | 30 | 0.4489 | 0.0 | 0.0 | 0.0 | 0.8 |
68
+ | No log | 11.0 | 33 | 0.4046 | 0.0 | 0.0 | 0.0 | 0.8 |
69
+ | No log | 12.0 | 36 | 0.3475 | 0.0 | 0.0 | 0.0 | 0.8 |
70
+ | No log | 13.0 | 39 | 0.3017 | 0.0 | 0.0 | 0.0 | 0.8 |
71
+ | No log | 14.0 | 42 | 0.2578 | 0.0 | 0.0 | 0.0 | 0.8 |
72
+ | No log | 15.0 | 45 | 0.2259 | 0.25 | 0.4 | 0.3077 | 0.88 |
73
+ | No log | 16.0 | 48 | 0.2010 | 0.25 | 0.4 | 0.3077 | 0.88 |
74
+ | No log | 17.0 | 51 | 0.1781 | 0.25 | 0.4 | 0.3077 | 0.88 |
75
+ | No log | 18.0 | 54 | 0.1556 | 0.25 | 0.4 | 0.3077 | 0.88 |
76
+ | No log | 19.0 | 57 | 0.1379 | 0.4286 | 0.6 | 0.5 | 0.92 |
77
+ | No log | 20.0 | 60 | 0.1260 | 0.4286 | 0.6 | 0.5 | 0.92 |
78
+ | No log | 21.0 | 63 | 0.1190 | 0.4286 | 0.6 | 0.5 | 0.92 |
79
+ | No log | 22.0 | 66 | 0.1121 | 0.4286 | 0.6 | 0.5 | 0.92 |
80
+ | No log | 23.0 | 69 | 0.1090 | 0.4286 | 0.6 | 0.5 | 0.92 |
81
+ | No log | 24.0 | 72 | 0.1082 | 0.4286 | 0.6 | 0.5 | 0.92 |
82
+ | No log | 25.0 | 75 | 0.1081 | 0.4286 | 0.6 | 0.5 | 0.92 |
83
+ | No log | 26.0 | 78 | 0.1094 | 0.4286 | 0.6 | 0.5 | 0.92 |
84
+ | No log | 27.0 | 81 | 0.1107 | 0.4286 | 0.6 | 0.5 | 0.92 |
85
+ | No log | 28.0 | 84 | 0.1111 | 0.4286 | 0.6 | 0.5 | 0.92 |
86
+ | No log | 29.0 | 87 | 0.1098 | 0.4286 | 0.6 | 0.5 | 0.92 |
87
+ | No log | 30.0 | 90 | 0.1083 | 0.4286 | 0.6 | 0.5 | 0.92 |
88
+ | No log | 31.0 | 93 | 0.1066 | 0.4286 | 0.6 | 0.5 | 0.92 |
89
+ | No log | 32.0 | 96 | 0.1038 | 0.4286 | 0.6 | 0.5 | 0.92 |
90
+ | No log | 33.0 | 99 | 0.1012 | 0.4286 | 0.6 | 0.5 | 0.92 |
91
+ | No log | 34.0 | 102 | 0.1000 | 0.4286 | 0.6 | 0.5 | 0.92 |
92
+ | No log | 35.0 | 105 | 0.0985 | 0.4286 | 0.6 | 0.5 | 0.92 |
93
+ | No log | 36.0 | 108 | 0.0969 | 0.4286 | 0.6 | 0.5 | 0.92 |
94
+ | No log | 37.0 | 111 | 0.0954 | 0.4286 | 0.6 | 0.5 | 0.92 |
95
+ | No log | 38.0 | 114 | 0.0938 | 0.4286 | 0.6 | 0.5 | 0.92 |
96
+ | No log | 39.0 | 117 | 0.0933 | 0.4286 | 0.6 | 0.5 | 0.92 |
97
+ | No log | 40.0 | 120 | 0.0929 | 0.4286 | 0.6 | 0.5 | 0.92 |
98
+ | No log | 41.0 | 123 | 0.0919 | 0.4286 | 0.6 | 0.5 | 0.92 |
99
+ | No log | 42.0 | 126 | 0.0915 | 0.4286 | 0.6 | 0.5 | 0.92 |
100
+ | No log | 43.0 | 129 | 0.0912 | 0.4286 | 0.6 | 0.5 | 0.92 |
101
+ | No log | 44.0 | 132 | 0.0909 | 0.4286 | 0.6 | 0.5 | 0.92 |
102
+ | No log | 45.0 | 135 | 0.0908 | 0.4286 | 0.6 | 0.5 | 0.92 |
103
+ | No log | 46.0 | 138 | 0.0907 | 0.4286 | 0.6 | 0.5 | 0.92 |
104
+ | No log | 47.0 | 141 | 0.0908 | 0.4286 | 0.6 | 0.5 | 0.92 |
105
+ | No log | 48.0 | 144 | 0.0907 | 0.4286 | 0.6 | 0.5 | 0.92 |
106
+ | No log | 49.0 | 147 | 0.0907 | 0.4286 | 0.6 | 0.5 | 0.92 |
107
+ | No log | 50.0 | 150 | 0.0907 | 0.4286 | 0.6 | 0.5 | 0.92 |
108
 
109
 
110
  ### Framework versions
config.json CHANGED
@@ -10,11 +10,13 @@
10
  "hidden_dim": 3072,
11
  "id2label": {
12
  "0": "O",
13
- "1": "CLASS"
 
14
  },
15
  "initializer_range": 0.02,
16
  "label2id": {
17
- "CLASS": 1,
 
18
  "O": 0
19
  },
20
  "max_position_embeddings": 512,
 
10
  "hidden_dim": 3072,
11
  "id2label": {
12
  "0": "O",
13
+ "1": "B-CLASS",
14
+ "2": "I-CLASS"
15
  },
16
  "initializer_range": 0.02,
17
  "label2id": {
18
+ "B-CLASS": 1,
19
+ "I-CLASS": 2,
20
  "O": 0
21
  },
22
  "max_position_embeddings": 512,
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7d92cc29fd518c37e95050a5c11d5dc0c60a6ebd305fe9415188ac9bfe24182a
3
- size 265470008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b64f61a0705edb515c0ad5fd692e5245bac7199cf114b95d60e00d792c2a15af
3
+ size 265473092
runs/Feb29_07-34-27_9879f2213cb5/events.out.tfevents.1709192082.9879f2213cb5.492.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:80712ce4b5d340a0e30bf2f4a23e8e7566cbe93ffb562319a508d84e7f60291a
3
+ size 28216
runs/Feb29_07-34-27_9879f2213cb5/events.out.tfevents.1709192291.9879f2213cb5.492.3 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:00027a2a8db95d1add5ab3d05784922260010d0402ca574272d40e68488e78bf
3
+ size 560
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fa4b0311eff1ed107fb9282c16af8087af42af62896bd56e3039530f47886da5
3
  size 4920
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8858b7e423a4905c3fe82b7a1443ffb266c95eac61afa7e57408be8d8ca9232d
3
  size 4920