Hugging Face's logo

whoisjones
/
finerweb-binary-classifier-mdeberta-gemma3

Text Classification
Transformers
Safetensors
deberta-v2
Generated from Trainer
Model card Files
xet
Community
whoisjones commited on
Commit
b38e1c1
·
verified ·
1 Parent(s): 3914b79

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -109
README.md CHANGED
@@ -47,115 +47,6 @@ The following hyperparameters were used during training:
47
  - lr_scheduler_type: linear
48
  - num_epochs: 20
49
 
50
- ### Training results
51
-
52
- | Training Loss | Epoch | Step | Validation Loss |
53
- |:-------------:|:-------:|:------:|:---------------:|
54
- | No log | 0 | 0 | 0.2170 |
55
- | 0.1238 | 0.1954 | 1000 | 0.1458 |
56
- | 0.1143 | 0.3908 | 2000 | 0.1076 |
57
- | 0.1208 | 0.5862 | 3000 | 0.1133 |
58
- | 0.1031 | 0.7816 | 4000 | 0.1069 |
59
- | 0.1045 | 0.9769 | 5000 | 0.1047 |
60
- | 0.0974 | 1.1723 | 6000 | 0.1087 |
61
- | 0.1337 | 1.3677 | 7000 | 0.1209 |
62
- | 0.0864 | 1.5631 | 8000 | 0.1151 |
63
- | 0.1049 | 1.7585 | 9000 | 0.1203 |
64
- | 0.0915 | 1.9539 | 10000 | 0.1255 |
65
- | 0.079 | 2.1493 | 11000 | 0.1369 |
66
- | 0.0709 | 2.3447 | 12000 | 0.1167 |
67
- | 0.0823 | 2.5401 | 13000 | 0.1257 |
68
- | 0.0725 | 2.7354 | 14000 | 0.1114 |
69
- | 0.066 | 2.9308 | 15000 | 0.1232 |
70
- | 0.0354 | 3.1262 | 16000 | 0.1321 |
71
- | 0.0486 | 3.3216 | 17000 | 0.1245 |
72
- | 0.0466 | 3.5170 | 18000 | 0.1329 |
73
- | 0.0523 | 3.7124 | 19000 | 0.1350 |
74
- | 0.0614 | 3.9078 | 20000 | 0.1373 |
75
- | 0.0349 | 4.1032 | 21000 | 0.1461 |
76
- | 0.0315 | 4.2986 | 22000 | 0.1406 |
77
- | 0.0337 | 4.4939 | 23000 | 0.1355 |
78
- | 0.0345 | 4.6893 | 24000 | 0.1300 |
79
- | 0.0324 | 4.8847 | 25000 | 0.1324 |
80
- | 0.0247 | 5.0801 | 26000 | 0.1347 |
81
- | 0.0306 | 5.2755 | 27000 | 0.1474 |
82
- | 0.0267 | 5.4709 | 28000 | 0.1394 |
83
- | 0.0204 | 5.6663 | 29000 | 0.1487 |
84
- | 0.0266 | 5.8617 | 30000 | 0.1454 |
85
- | 0.0188 | 6.0571 | 31000 | 0.1434 |
86
- | 0.0192 | 6.2524 | 32000 | 0.1458 |
87
- | 0.0246 | 6.4478 | 33000 | 0.1455 |
88
- | 0.0219 | 6.6432 | 34000 | 0.1440 |
89
- | 0.0231 | 6.8386 | 35000 | 0.1561 |
90
- | 0.0185 | 7.0340 | 36000 | 0.1504 |
91
- | 0.0163 | 7.2294 | 37000 | 0.1516 |
92
- | 0.0186 | 7.4248 | 38000 | 0.1451 |
93
- | 0.0250 | 7.6202 | 39000 | 0.1423 |
94
- | 0.0217 | 7.8156 | 40000 | 0.1453 |
95
- | 0.0226 | 8.0109 | 41000 | 0.1584 |
96
- | 0.0136 | 8.2063 | 42000 | 0.1589 |
97
- | 0.0186 | 8.4017 | 43000 | 0.1518 |
98
- | 0.0215 | 8.5971 | 44000 | 0.1459 |
99
- | 0.0182 | 8.7925 | 45000 | 0.1437 |
100
- | 0.0236 | 8.9879 | 46000 | 0.1409 |
101
- | 0.0204 | 9.1833 | 47000 | 0.1514 |
102
- | 0.0198 | 9.3787 | 48000 | 0.1617 |
103
- | 0.0158 | 9.5741 | 49000 | 0.1366 |
104
- | 0.0256 | 9.7694 | 50000 | 0.1450 |
105
- | 0.0186 | 9.9648 | 51000 | 0.1525 |
106
- | 0.0238 | 10.1602 | 52000 | 0.1658 |
107
- | 0.0189 | 10.3556 | 53000 | 0.1442 |
108
- | 0.0184 | 10.5510 | 54000 | 0.1495 |
109
- | 0.0196 | 10.7464 | 55000 | 0.1428 |
110
- | 0.0224 | 10.9418 | 56000 | 0.1606 |
111
- | 0.0180 | 11.1372 | 57000 | 0.1436 |
112
- | 0.1813 | 11.3326 | 58000 | 0.1829 |
113
- | 0.1888 | 11.5279 | 59000 | 0.1832 |
114
- | 0.1826 | 11.7233 | 60000 | 0.1828 |
115
- | 0.0227 | 11.9187 | 61000 | 0.1447 |
116
- | 0.0162 | 12.1141 | 62000 | 0.1491 |
117
- | 0.0212 | 12.3095 | 63000 | 0.1386 |
118
- | 0.0124 | 12.5049 | 64000 | 0.1507 |
119
- | 0.0162 | 12.7003 | 65000 | 0.1425 |
120
- | 0.0122 | 12.8957 | 66000 | 0.1417 |
121
- | 0.0105 | 13.0911 | 67000 | 0.1414 |
122
- | 0.0114 | 13.2864 | 68000 | 0.1537 |
123
- | 0.0083 | 13.4818 | 69000 | 0.1548 |
124
- | 0.0084 | 13.6772 | 70000 | 0.1439 |
125
- | 0.0113 | 13.8726 | 71000 | 0.1504 |
126
- | 0.0130 | 14.0680 | 72000 | 0.1480 |
127
- | 0.0066 | 14.2634 | 73000 | 0.1544 |
128
- | 0.0119 | 14.4588 | 74000 | 0.1509 |
129
- | 0.0078 | 14.6542 | 75000 | 0.1546 |
130
- | 0.0162 | 14.8496 | 76000 | 0.1513 |
131
- | 0.0094 | 15.0449 | 77000 | 0.1571 |
132
- | 0.0097 | 15.2403 | 78000 | 0.1646 |
133
- | 0.0132 | 15.4357 | 79000 | 0.1505 |
134
- | 0.0127 | 15.6311 | 80000 | 0.1539 |
135
- | 0.0086 | 15.8265 | 81000 | 0.1572 |
136
- | 0.0067 | 16.0219 | 82000 | 0.1583 |
137
- | 0.0070 | 16.2173 | 83000 | 0.1531 |
138
- | 0.0117 | 16.4127 | 84000 | 0.1485 |
139
- | 0.0156 | 16.6081 | 85000 | 0.1495 |
140
- | 0.0089 | 16.8034 | 86000 | 0.1570 |
141
- | 0.0075 | 16.9988 | 87000 | 0.1540 |
142
- | 0.0068 | 17.1942 | 88000 | 0.1612 |
143
- | 0.0074 | 17.3896 | 89000 | 0.1596 |
144
- | 0.0117 | 17.5850 | 90000 | 0.1617 |
145
- | 0.0116 | 17.7804 | 91000 | 0.1689 |
146
- | 0.0064 | 17.9758 | 92000 | 0.1602 |
147
- | 0.0079 | 18.1712 | 93000 | 0.1647 |
148
- | 0.0051 | 18.3665 | 94000 | 0.1534 |
149
- | 0.0069 | 18.5619 | 95000 | 0.1570 |
150
- | 0.0062 | 18.7573 | 96000 | 0.1533 |
151
- | 0.0048 | 18.9527 | 97000 | 0.1566 |
152
- | 0.0142 | 19.1481 | 98000 | 0.1532 |
153
- | 0.0147 | 19.3435 | 99000 | 0.1501 |
154
- | 0.0085 | 19.5389 | 100000 | 0.1535 |
155
- | 0.0050 | 19.7343 | 101000 | 0.1599 |
156
- | 0.0066 | 19.9297 | 102000 | 0.1614 |
157
-
158
-
159
  ### Framework versions
160
 
161
  - Transformers 4.49.0
 
47
  - lr_scheduler_type: linear
48
  - num_epochs: 20
49
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
50
  ### Framework versions
51
 
52
  - Transformers 4.49.0