satyanshu404
commited on
Commit
•
dfdc38c
1
Parent(s):
dcbed9a
End of training
Browse files- README.md +52 -52
- model.safetensors +1 -1
- training_args.bin +1 -1
README.md
CHANGED
@@ -17,8 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
|
|
17 |
|
18 |
This model is a fine-tuned version of [allenai/longformer-base-4096](https://huggingface.co/allenai/longformer-base-4096) on the None dataset.
|
19 |
It achieves the following results on the evaluation set:
|
20 |
-
- Loss: 4.
|
21 |
-
- Accuracy: 0.
|
22 |
|
23 |
## Model description
|
24 |
|
@@ -49,56 +49,56 @@ The following hyperparameters were used during training:
|
|
49 |
|
50 |
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|
51 |
|:-------------:|:-----:|:-----:|:---------------:|:--------:|
|
52 |
-
| No log | 1.0 | 338 | 0.
|
53 |
-
| 0.
|
54 |
-
| 0.
|
55 |
-
| 0.
|
56 |
-
| 0.
|
57 |
-
| 0.
|
58 |
-
| 0.
|
59 |
-
| 0.
|
60 |
-
| 0.
|
61 |
-
| 0.
|
62 |
-
| 0.
|
63 |
-
| 0.
|
64 |
-
| 0.
|
65 |
-
| 0.
|
66 |
-
| 0.
|
67 |
-
| 0.
|
68 |
-
| 0.
|
69 |
-
| 0.
|
70 |
-
| 0.
|
71 |
-
| 0.
|
72 |
-
| 0.
|
73 |
-
| 0.
|
74 |
-
| 0.
|
75 |
-
| 0.
|
76 |
-
| 0.
|
77 |
-
| 0.
|
78 |
-
| 0.
|
79 |
-
| 0.
|
80 |
-
| 0.
|
81 |
-
| 0.
|
82 |
-
| 0.
|
83 |
-
| 0.
|
84 |
-
| 0.
|
85 |
-
| 0.
|
86 |
-
| 0.
|
87 |
-
| 0.
|
88 |
-
| 0.
|
89 |
-
| 0.
|
90 |
-
| 0.0 | 39.0 | 13182 | 4.
|
91 |
-
| 0.0 | 40.0 | 13520 | 4.
|
92 |
-
| 0.0 | 41.0 | 13858 | 4.
|
93 |
-
| 0.
|
94 |
-
| 0.
|
95 |
-
| 0.
|
96 |
-
| 0.0 | 45.0 | 15210 | 4.
|
97 |
-
| 0.
|
98 |
-
| 0.
|
99 |
-
| 0.0 | 48.0 | 16224 | 4.
|
100 |
-
| 0.
|
101 |
-
| 0.
|
102 |
|
103 |
|
104 |
### Framework versions
|
|
|
17 |
|
18 |
This model is a fine-tuned version of [allenai/longformer-base-4096](https://huggingface.co/allenai/longformer-base-4096) on the None dataset.
|
19 |
It achieves the following results on the evaluation set:
|
20 |
+
- Loss: 4.7320
|
21 |
+
- Accuracy: 0.6345
|
22 |
|
23 |
## Model description
|
24 |
|
|
|
49 |
|
50 |
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|
51 |
|:-------------:|:-----:|:-----:|:---------------:|:--------:|
|
52 |
+
| No log | 1.0 | 338 | 0.6871 | 0.5586 |
|
53 |
+
| 0.7716 | 2.0 | 676 | 1.3578 | 0.5931 |
|
54 |
+
| 0.8734 | 3.0 | 1014 | 1.1640 | 0.6552 |
|
55 |
+
| 0.8734 | 4.0 | 1352 | 1.2912 | 0.6690 |
|
56 |
+
| 0.7616 | 5.0 | 1690 | 1.6544 | 0.6414 |
|
57 |
+
| 0.6167 | 6.0 | 2028 | 1.6598 | 0.6276 |
|
58 |
+
| 0.6167 | 7.0 | 2366 | 1.8299 | 0.6759 |
|
59 |
+
| 0.4001 | 8.0 | 2704 | 1.6994 | 0.6759 |
|
60 |
+
| 0.2597 | 9.0 | 3042 | 2.6242 | 0.6207 |
|
61 |
+
| 0.2597 | 10.0 | 3380 | 2.6644 | 0.6414 |
|
62 |
+
| 0.1271 | 11.0 | 3718 | 3.1617 | 0.6207 |
|
63 |
+
| 0.1108 | 12.0 | 4056 | 3.6947 | 0.5862 |
|
64 |
+
| 0.1108 | 13.0 | 4394 | 2.4827 | 0.6690 |
|
65 |
+
| 0.1297 | 14.0 | 4732 | 3.1760 | 0.6552 |
|
66 |
+
| 0.0621 | 15.0 | 5070 | 2.9946 | 0.6414 |
|
67 |
+
| 0.0621 | 16.0 | 5408 | 3.4196 | 0.6138 |
|
68 |
+
| 0.0802 | 17.0 | 5746 | 3.2127 | 0.6276 |
|
69 |
+
| 0.0321 | 18.0 | 6084 | 4.0789 | 0.5724 |
|
70 |
+
| 0.0321 | 19.0 | 6422 | 3.4500 | 0.6414 |
|
71 |
+
| 0.095 | 20.0 | 6760 | 3.6493 | 0.6207 |
|
72 |
+
| 0.066 | 21.0 | 7098 | 3.6884 | 0.6483 |
|
73 |
+
| 0.066 | 22.0 | 7436 | 3.6964 | 0.6414 |
|
74 |
+
| 0.0311 | 23.0 | 7774 | 3.9008 | 0.6414 |
|
75 |
+
| 0.0 | 24.0 | 8112 | 3.9903 | 0.6414 |
|
76 |
+
| 0.0 | 25.0 | 8450 | 4.1142 | 0.6483 |
|
77 |
+
| 0.0 | 26.0 | 8788 | 4.1873 | 0.6483 |
|
78 |
+
| 0.0287 | 27.0 | 9126 | 2.7993 | 0.6828 |
|
79 |
+
| 0.0287 | 28.0 | 9464 | 2.8943 | 0.6897 |
|
80 |
+
| 0.1471 | 29.0 | 9802 | 3.0466 | 0.6552 |
|
81 |
+
| 0.0346 | 30.0 | 10140 | 3.6512 | 0.6207 |
|
82 |
+
| 0.0346 | 31.0 | 10478 | 3.7744 | 0.6207 |
|
83 |
+
| 0.0 | 32.0 | 10816 | 4.1046 | 0.6138 |
|
84 |
+
| 0.0202 | 33.0 | 11154 | 4.1819 | 0.5724 |
|
85 |
+
| 0.0202 | 34.0 | 11492 | 3.8847 | 0.6276 |
|
86 |
+
| 0.034 | 35.0 | 11830 | 4.4781 | 0.5793 |
|
87 |
+
| 0.008 | 36.0 | 12168 | 3.8375 | 0.6483 |
|
88 |
+
| 0.0 | 37.0 | 12506 | 3.9397 | 0.6483 |
|
89 |
+
| 0.0 | 38.0 | 12844 | 4.0213 | 0.6483 |
|
90 |
+
| 0.0 | 39.0 | 13182 | 4.0805 | 0.6483 |
|
91 |
+
| 0.0 | 40.0 | 13520 | 4.1432 | 0.6483 |
|
92 |
+
| 0.0 | 41.0 | 13858 | 4.6171 | 0.6207 |
|
93 |
+
| 0.0038 | 42.0 | 14196 | 4.6608 | 0.6207 |
|
94 |
+
| 0.0 | 43.0 | 14534 | 4.6955 | 0.6207 |
|
95 |
+
| 0.0 | 44.0 | 14872 | 4.7289 | 0.6207 |
|
96 |
+
| 0.0 | 45.0 | 15210 | 4.7580 | 0.6207 |
|
97 |
+
| 0.0 | 46.0 | 15548 | 4.7836 | 0.6276 |
|
98 |
+
| 0.0 | 47.0 | 15886 | 4.7811 | 0.6276 |
|
99 |
+
| 0.0 | 48.0 | 16224 | 4.7987 | 0.6276 |
|
100 |
+
| 0.001 | 49.0 | 16562 | 4.7271 | 0.6345 |
|
101 |
+
| 0.001 | 50.0 | 16900 | 4.7320 | 0.6345 |
|
102 |
|
103 |
|
104 |
### Framework versions
|
model.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 594678184
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:be4e70e03c208351c0093cde2742dd92691883c02cdb409afad09c5c1362fdbf
|
3 |
size 594678184
|
training_args.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 4792
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8d1bcdc557113ebe2d2fccbe040dc89d49fd7a9e8d7c3aeaca4781bd12d09e5c
|
3 |
size 4792
|