File size: 22,008 Bytes
b1ceeb7
932a0e1
0e7691b
b1ceeb7
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
932a0e1
 
 
 
 
 
b1ceeb7
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
932a0e1
 
 
b1ceeb7
 
 
 
932a0e1
b1ceeb7
 
 
932a0e1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
b1ceeb7
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
---
license: apache-2.0
base_model: lemon-mint/LaBSE-EnKo-Nano-Preview-v0.3
tags:
- generated_from_trainer
metrics:
- precision
- recall
- accuracy
model-index:
- name: ko-edu-classifier
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# ko-edu-classifier

This model is a fine-tuned version of [lemon-mint/LaBSE-EnKo-Nano-Preview-v0.3](https://huggingface.co/lemon-mint/LaBSE-EnKo-Nano-Preview-v0.3) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 0.3773
- Precision: 0.2713
- Recall: 0.2016
- F1 Macro: 0.1949
- Accuracy: 0.5907

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.0005
- train_batch_size: 64
- eval_batch_size: 64
- seed: 0
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: cosine
- lr_scheduler_warmup_ratio: 0.2
- num_epochs: 20

### Training results

| Training Loss | Epoch   | Step  | Validation Loss | Precision | Recall | F1 Macro | Accuracy |
|:-------------:|:-------:|:-----:|:---------------:|:---------:|:------:|:--------:|:--------:|
| 3.8465        | 0.0945  | 256   | 3.0189          | 0.0366    | 0.1607 | 0.0341   | 0.0453   |
| 1.8667        | 0.1890  | 512   | 0.8075          | 0.1370    | 0.1744 | 0.1380   | 0.3775   |
| 0.5548        | 0.2835  | 768   | 0.4790          | 0.2172    | 0.1802 | 0.1642   | 0.5589   |
| 0.4568        | 0.3780  | 1024  | 0.4423          | 0.2393    | 0.1822 | 0.1665   | 0.5652   |
| 0.4347        | 0.4725  | 1280  | 0.4239          | 0.2335    | 0.1842 | 0.1707   | 0.5658   |
| 0.4217        | 0.5670  | 1536  | 0.4139          | 0.2458    | 0.1912 | 0.1814   | 0.5745   |
| 0.421         | 0.6615  | 1792  | 0.4068          | 0.2593    | 0.1968 | 0.1896   | 0.5817   |
| 0.4024        | 0.7560  | 2048  | 0.3991          | 0.2657    | 0.1946 | 0.1856   | 0.5821   |
| 0.4024        | 0.8505  | 2304  | 0.3964          | 0.2669    | 0.2010 | 0.1954   | 0.5876   |
| 0.3864        | 0.9450  | 2560  | 0.3937          | 0.2636    | 0.1967 | 0.1891   | 0.5842   |
| 0.3989        | 1.0395  | 2816  | 0.3927          | 0.2623    | 0.1983 | 0.1916   | 0.5849   |
| 0.391         | 1.1340  | 3072  | 0.3930          | 0.2617    | 0.1982 | 0.1911   | 0.5842   |
| 0.3905        | 1.2285  | 3328  | 0.3920          | 0.2677    | 0.1988 | 0.1914   | 0.5876   |
| 0.3919        | 1.3230  | 3584  | 0.3911          | 0.2591    | 0.1972 | 0.1895   | 0.5824   |
| 0.3831        | 1.4175  | 3840  | 0.3909          | 0.2699    | 0.2027 | 0.1972   | 0.5883   |
| 0.3903        | 1.5120  | 4096  | 0.3883          | 0.2663    | 0.2018 | 0.1966   | 0.5866   |
| 0.389         | 1.6065  | 4352  | 0.3862          | 0.2640    | 0.2024 | 0.1977   | 0.5869   |
| 0.3913        | 1.7010  | 4608  | 0.3886          | 0.2575    | 0.2018 | 0.1963   | 0.5821   |
| 0.3913        | 1.7955  | 4864  | 0.3859          | 0.2605    | 0.1958 | 0.1875   | 0.5835   |
| 0.3783        | 1.8900  | 5120  | 0.3865          | 0.2611    | 0.1968 | 0.1894   | 0.5835   |
| 0.3854        | 1.9845  | 5376  | 0.3877          | 0.2637    | 0.2025 | 0.1978   | 0.5859   |
| 0.3816        | 2.0790  | 5632  | 0.3855          | 0.2630    | 0.1981 | 0.1915   | 0.5845   |
| 0.3798        | 2.1735  | 5888  | 0.3848          | 0.2637    | 0.1989 | 0.1927   | 0.5856   |
| 0.3807        | 2.2680  | 6144  | 0.3856          | 0.2665    | 0.2008 | 0.1943   | 0.5876   |
| 0.3886        | 2.3625  | 6400  | 0.3855          | 0.2606    | 0.1943 | 0.1845   | 0.5824   |
| 0.3744        | 2.4570  | 6656  | 0.3894          | 0.2646    | 0.2045 | 0.2001   | 0.5856   |
| 0.3884        | 2.5515  | 6912  | 0.3859          | 0.2622    | 0.2017 | 0.1961   | 0.5849   |
| 0.3888        | 2.6460  | 7168  | 0.3841          | 0.2597    | 0.1939 | 0.1849   | 0.5811   |
| 0.3768        | 2.7405  | 7424  | 0.3866          | 0.2597    | 0.1975 | 0.1896   | 0.5828   |
| 0.3851        | 2.8350  | 7680  | 0.3853          | 0.2690    | 0.1963 | 0.1875   | 0.5828   |
| 0.3846        | 2.9295  | 7936  | 0.3834          | 0.2597    | 0.1939 | 0.1836   | 0.5824   |
| 0.3814        | 3.0240  | 8192  | 0.3932          | 0.2692    | 0.2004 | 0.1911   | 0.5838   |
| 0.3811        | 3.1185  | 8448  | 0.3891          | 0.2657    | 0.2018 | 0.1946   | 0.5845   |
| 0.3773        | 3.2130  | 8704  | 0.3828          | 0.2677    | 0.2023 | 0.1972   | 0.5873   |
| 0.3711        | 3.3075  | 8960  | 0.3837          | 0.2654    | 0.1998 | 0.1925   | 0.5862   |
| 0.3863        | 3.4020  | 9216  | 0.3824          | 0.2669    | 0.1969 | 0.1888   | 0.5866   |
| 0.3884        | 3.4965  | 9472  | 0.3873          | 0.2643    | 0.1984 | 0.1905   | 0.5852   |
| 0.3828        | 3.5910  | 9728  | 0.3937          | 0.2594    | 0.1993 | 0.1907   | 0.5779   |
| 0.3794        | 3.6855  | 9984  | 0.3828          | 0.2552    | 0.1928 | 0.1819   | 0.5828   |
| 0.383         | 3.7800  | 10240 | 0.3829          | 0.2586    | 0.1922 | 0.1812   | 0.5821   |
| 0.3821        | 3.8745  | 10496 | 0.4009          | 0.2666    | 0.2048 | 0.1943   | 0.5842   |
| 0.3755        | 3.9690  | 10752 | 0.3818          | 0.2667    | 0.2076 | 0.2070   | 0.5862   |
| 0.372         | 4.0635  | 11008 | 0.3817          | 0.2647    | 0.1966 | 0.1886   | 0.5852   |
| 0.3795        | 4.1580  | 11264 | 0.3958          | 0.2719    | 0.2054 | 0.1961   | 0.5894   |
| 0.3821        | 4.2525  | 11520 | 0.3820          | 0.2626    | 0.1974 | 0.1901   | 0.5845   |
| 0.3764        | 4.3470  | 11776 | 0.3866          | 0.2665    | 0.2054 | 0.1982   | 0.5887   |
| 0.3753        | 4.4415  | 12032 | 0.3803          | 0.2582    | 0.1945 | 0.1854   | 0.5821   |
| 0.3813        | 4.5360  | 12288 | 0.3959          | 0.2721    | 0.2064 | 0.1967   | 0.5869   |
| 0.3765        | 4.6305  | 12544 | 0.3798          | 0.2684    | 0.2018 | 0.1967   | 0.5890   |
| 0.3832        | 4.7250  | 12800 | 0.3802          | 0.2596    | 0.1988 | 0.1923   | 0.5828   |
| 0.3849        | 4.8195  | 13056 | 0.3838          | 0.2528    | 0.1955 | 0.1878   | 0.5741   |
| 0.3766        | 4.9140  | 13312 | 0.3916          | 0.2588    | 0.1987 | 0.1914   | 0.5752   |
| 0.3744        | 5.0085  | 13568 | 0.3791          | 0.2689    | 0.1995 | 0.1916   | 0.5883   |
| 0.3811        | 5.1030  | 13824 | 0.3814          | 0.2630    | 0.1936 | 0.1825   | 0.5835   |
| 0.3761        | 5.1975  | 14080 | 0.3835          | 0.2656    | 0.1963 | 0.1867   | 0.5849   |
| 0.3701        | 5.2920  | 14336 | 0.3811          | 0.2611    | 0.1988 | 0.1931   | 0.5831   |
| 0.3775        | 5.3865  | 14592 | 0.3820          | 0.2585    | 0.1944 | 0.1850   | 0.5828   |
| 0.3778        | 5.4810  | 14848 | 0.4007          | 0.2653    | 0.2109 | 0.2018   | 0.5849   |
| 0.3763        | 5.5755  | 15104 | 0.3822          | 0.2672    | 0.1975 | 0.1888   | 0.5869   |
| 0.3741        | 5.6700  | 15360 | 0.3865          | 0.2671    | 0.2028 | 0.1954   | 0.5869   |
| 0.3779        | 5.7645  | 15616 | 0.3848          | 0.2661    | 0.1985 | 0.1915   | 0.5745   |
| 0.3783        | 5.8590  | 15872 | 0.3823          | 0.2643    | 0.1950 | 0.1857   | 0.5831   |
| 0.3774        | 5.9535  | 16128 | 0.3791          | 0.2707    | 0.2020 | 0.1956   | 0.5911   |
| 0.3742        | 6.0480  | 16384 | 0.3805          | 0.2643    | 0.2019 | 0.1970   | 0.5862   |
| 0.3712        | 6.1425  | 16640 | 0.3838          | 0.2690    | 0.1984 | 0.1913   | 0.5811   |
| 0.3714        | 6.2370  | 16896 | 0.3844          | 0.2713    | 0.2003 | 0.1926   | 0.5835   |
| 0.3769        | 6.3315  | 17152 | 0.3830          | 0.2731    | 0.1968 | 0.1887   | 0.5828   |
| 0.3714        | 6.4260  | 17408 | 0.3816          | 0.2651    | 0.1938 | 0.1841   | 0.5797   |
| 0.3804        | 6.5205  | 17664 | 0.3803          | 0.2610    | 0.1998 | 0.1946   | 0.5835   |
| 0.3778        | 6.6150  | 17920 | 0.3833          | 0.2676    | 0.2038 | 0.1972   | 0.5869   |
| 0.3755        | 6.7095  | 18176 | 0.3791          | 0.2740    | 0.1998 | 0.1933   | 0.5900   |
| 0.3777        | 6.8040  | 18432 | 0.3851          | 0.2680    | 0.2064 | 0.1991   | 0.5876   |
| 0.3762        | 6.8985  | 18688 | 0.3804          | 0.2705    | 0.2060 | 0.2034   | 0.5914   |
| 0.3708        | 6.9930  | 18944 | 0.3792          | 0.2639    | 0.1994 | 0.1930   | 0.5869   |
| 0.3756        | 7.0875  | 19200 | 0.3822          | 0.2626    | 0.2042 | 0.1985   | 0.5852   |
| 0.3724        | 7.1820  | 19456 | 0.3828          | 0.2601    | 0.1997 | 0.1920   | 0.5828   |
| 0.374         | 7.2765  | 19712 | 0.3805          | 0.2652    | 0.1948 | 0.1848   | 0.5849   |
| 0.3691        | 7.3710  | 19968 | 0.4004          | 0.2752    | 0.2007 | 0.1914   | 0.5721   |
| 0.3721        | 7.4655  | 20224 | 0.3788          | 0.2670    | 0.1989 | 0.1921   | 0.5869   |
| 0.3757        | 7.5600  | 20480 | 0.3818          | 0.2743    | 0.2001 | 0.1905   | 0.5904   |
| 0.3699        | 7.6545  | 20736 | 0.3919          | 0.2774    | 0.2048 | 0.1951   | 0.5880   |
| 0.3705        | 7.7490  | 20992 | 0.3796          | 0.2607    | 0.1972 | 0.1895   | 0.5838   |
| 0.3783        | 7.8435  | 21248 | 0.3826          | 0.2752    | 0.2070 | 0.2002   | 0.5932   |
| 0.3806        | 7.9380  | 21504 | 0.3835          | 0.2593    | 0.1991 | 0.1904   | 0.5835   |
| 0.3828        | 8.0325  | 21760 | 0.3806          | 0.2643    | 0.1965 | 0.1888   | 0.5821   |
| 0.3761        | 8.1270  | 22016 | 0.3794          | 0.2668    | 0.2026 | 0.1953   | 0.5873   |
| 0.3811        | 8.2215  | 22272 | 0.3834          | 0.2600    | 0.2025 | 0.1947   | 0.5856   |
| 0.3667        | 8.3160  | 22528 | 0.3845          | 0.2619    | 0.2009 | 0.1925   | 0.5845   |
| 0.3697        | 8.4105  | 22784 | 0.3845          | 0.2733    | 0.2026 | 0.1948   | 0.5900   |
| 0.3689        | 8.5050  | 23040 | 0.3939          | 0.2635    | 0.2009 | 0.1918   | 0.5776   |
| 0.3682        | 8.5995  | 23296 | 0.3787          | 0.2695    | 0.2004 | 0.1947   | 0.5883   |
| 0.3717        | 8.6940  | 23552 | 0.3838          | 0.2704    | 0.1955 | 0.1856   | 0.5831   |
| 0.3696        | 8.7885  | 23808 | 0.3850          | 0.2571    | 0.2010 | 0.1923   | 0.5811   |
| 0.3713        | 8.8830  | 24064 | 0.3800          | 0.2639    | 0.1969 | 0.1879   | 0.5859   |
| 0.3736        | 8.9775  | 24320 | 0.3816          | 0.2747    | 0.2037 | 0.1983   | 0.5925   |
| 0.3745        | 9.0720  | 24576 | 0.3807          | 0.2643    | 0.1986 | 0.1920   | 0.5849   |
| 0.3653        | 9.1665  | 24832 | 0.3818          | 0.2648    | 0.1944 | 0.1839   | 0.5845   |
| 0.3748        | 9.2610  | 25088 | 0.3813          | 0.2670    | 0.2090 | 0.2064   | 0.5887   |
| 0.3715        | 9.3555  | 25344 | 0.3812          | 0.2682    | 0.2019 | 0.1949   | 0.5887   |
| 0.3716        | 9.4500  | 25600 | 0.3790          | 0.2699    | 0.2021 | 0.1970   | 0.5897   |
| 0.3757        | 9.5445  | 25856 | 0.3810          | 0.2670    | 0.1968 | 0.1880   | 0.5873   |
| 0.3648        | 9.6390  | 26112 | 0.3797          | 0.2678    | 0.2010 | 0.1932   | 0.5883   |
| 0.372         | 9.7335  | 26368 | 0.3788          | 0.2683    | 0.2065 | 0.2020   | 0.5897   |
| 0.3667        | 9.8280  | 26624 | 0.3785          | 0.2741    | 0.2005 | 0.1950   | 0.5887   |
| 0.3784        | 9.9225  | 26880 | 0.3822          | 0.2735    | 0.2050 | 0.1979   | 0.5911   |
| 0.3766        | 10.0170 | 27136 | 0.3951          | 0.2620    | 0.2082 | 0.1990   | 0.5807   |
| 0.3737        | 10.1115 | 27392 | 0.3781          | 0.2665    | 0.2020 | 0.1968   | 0.5873   |
| 0.3683        | 10.2060 | 27648 | 0.3764          | 0.2680    | 0.2026 | 0.1984   | 0.5883   |
| 0.3627        | 10.3005 | 27904 | 0.3807          | 0.2684    | 0.1980 | 0.1903   | 0.5887   |
| 0.3732        | 10.3950 | 28160 | 0.3788          | 0.2626    | 0.1950 | 0.1862   | 0.5835   |
| 0.3758        | 10.4895 | 28416 | 0.3830          | 0.2662    | 0.1998 | 0.1916   | 0.5859   |
| 0.3634        | 10.5840 | 28672 | 0.3829          | 0.2621    | 0.1998 | 0.1911   | 0.5838   |
| 0.3742        | 10.6785 | 28928 | 0.3842          | 0.2684    | 0.2029 | 0.1982   | 0.5838   |
| 0.3685        | 10.7730 | 29184 | 0.3768          | 0.2693    | 0.1989 | 0.1921   | 0.5880   |
| 0.3681        | 10.8675 | 29440 | 0.3770          | 0.2689    | 0.1997 | 0.1935   | 0.5880   |
| 0.3793        | 10.9620 | 29696 | 0.3789          | 0.2660    | 0.1987 | 0.1899   | 0.5887   |
| 0.3771        | 11.0565 | 29952 | 0.3825          | 0.2670    | 0.2016 | 0.1931   | 0.5873   |
| 0.3638        | 11.1510 | 30208 | 0.3840          | 0.2668    | 0.1977 | 0.1901   | 0.5821   |
| 0.3666        | 11.2455 | 30464 | 0.3836          | 0.2675    | 0.2008 | 0.1920   | 0.5876   |
| 0.3702        | 11.3400 | 30720 | 0.3793          | 0.2691    | 0.2016 | 0.1970   | 0.5869   |
| 0.3679        | 11.4345 | 30976 | 0.3796          | 0.2722    | 0.1976 | 0.1898   | 0.5876   |
| 0.3602        | 11.5290 | 31232 | 0.3814          | 0.2676    | 0.2031 | 0.1957   | 0.5883   |
| 0.3816        | 11.6235 | 31488 | 0.3825          | 0.2592    | 0.1997 | 0.1915   | 0.5831   |
| 0.3688        | 11.7180 | 31744 | 0.3790          | 0.2613    | 0.1991 | 0.1929   | 0.5835   |
| 0.3712        | 11.8125 | 32000 | 0.3795          | 0.2666    | 0.1997 | 0.1910   | 0.5883   |
| 0.3744        | 11.9070 | 32256 | 0.3778          | 0.2698    | 0.1998 | 0.1922   | 0.5887   |
| 0.3686        | 12.0015 | 32512 | 0.3775          | 0.2644    | 0.2008 | 0.1941   | 0.5876   |
| 0.3698        | 12.0960 | 32768 | 0.3813          | 0.2695    | 0.2041 | 0.1966   | 0.5894   |
| 0.3628        | 12.1905 | 33024 | 0.3772          | 0.2707    | 0.2000 | 0.1933   | 0.5894   |
| 0.37          | 12.2850 | 33280 | 0.3818          | 0.2692    | 0.2053 | 0.1990   | 0.5897   |
| 0.3735        | 12.3795 | 33536 | 0.3763          | 0.2662    | 0.2015 | 0.1953   | 0.5880   |
| 0.3662        | 12.4740 | 33792 | 0.3779          | 0.2704    | 0.2049 | 0.2002   | 0.5907   |
| 0.3732        | 12.5685 | 34048 | 0.3796          | 0.2665    | 0.2004 | 0.1925   | 0.5880   |
| 0.364         | 12.6630 | 34304 | 0.3803          | 0.2660    | 0.2016 | 0.1948   | 0.5890   |
| 0.3722        | 12.7575 | 34560 | 0.3787          | 0.2689    | 0.2046 | 0.2003   | 0.5904   |
| 0.3701        | 12.8520 | 34816 | 0.3828          | 0.2688    | 0.2050 | 0.1984   | 0.5883   |
| 0.3697        | 12.9465 | 35072 | 0.3932          | 0.2674    | 0.2088 | 0.1993   | 0.5852   |
| 0.3671        | 13.0410 | 35328 | 0.3762          | 0.2685    | 0.1992 | 0.1925   | 0.5873   |
| 0.3641        | 13.1355 | 35584 | 0.3776          | 0.2654    | 0.2006 | 0.1939   | 0.5876   |
| 0.3707        | 13.2300 | 35840 | 0.3793          | 0.2678    | 0.2022 | 0.1948   | 0.5883   |
| 0.365         | 13.3245 | 36096 | 0.3771          | 0.2713    | 0.2015 | 0.1960   | 0.5900   |
| 0.3733        | 13.4190 | 36352 | 0.3775          | 0.2701    | 0.2017 | 0.1970   | 0.5883   |
| 0.3688        | 13.5135 | 36608 | 0.3881          | 0.2663    | 0.2036 | 0.1945   | 0.5835   |
| 0.3706        | 13.6080 | 36864 | 0.3805          | 0.2708    | 0.2036 | 0.1971   | 0.5907   |
| 0.3736        | 13.7025 | 37120 | 0.3778          | 0.2694    | 0.2013 | 0.1964   | 0.5876   |
| 0.3666        | 13.7970 | 37376 | 0.3802          | 0.2655    | 0.2020 | 0.1947   | 0.5876   |
| 0.3702        | 13.8915 | 37632 | 0.3791          | 0.2741    | 0.1989 | 0.1911   | 0.5911   |
| 0.3587        | 13.9860 | 37888 | 0.3804          | 0.2666    | 0.2026 | 0.1962   | 0.5873   |
| 0.3676        | 14.0805 | 38144 | 0.3867          | 0.2729    | 0.2042 | 0.1953   | 0.5866   |
| 0.3649        | 14.1750 | 38400 | 0.3778          | 0.2687    | 0.2015 | 0.1955   | 0.5894   |
| 0.3658        | 14.2695 | 38656 | 0.3778          | 0.2636    | 0.1995 | 0.1938   | 0.5845   |
| 0.3579        | 14.3640 | 38912 | 0.3796          | 0.2709    | 0.2047 | 0.1988   | 0.5907   |
| 0.3654        | 14.4585 | 39168 | 0.3783          | 0.2643    | 0.1971 | 0.1881   | 0.5862   |
| 0.3706        | 14.5530 | 39424 | 0.3769          | 0.2674    | 0.2009 | 0.1951   | 0.5876   |
| 0.3689        | 14.6475 | 39680 | 0.3779          | 0.2666    | 0.2041 | 0.1985   | 0.5890   |
| 0.3654        | 14.7420 | 39936 | 0.3776          | 0.2715    | 0.2015 | 0.1952   | 0.5904   |
| 0.3724        | 14.8365 | 40192 | 0.3791          | 0.2711    | 0.2037 | 0.1982   | 0.5914   |
| 0.3709        | 14.9310 | 40448 | 0.3778          | 0.2673    | 0.1976 | 0.1902   | 0.5862   |
| 0.3703        | 15.0255 | 40704 | 0.3803          | 0.2654    | 0.2018 | 0.1940   | 0.5873   |
| 0.3644        | 15.1200 | 40960 | 0.3776          | 0.2714    | 0.2004 | 0.1940   | 0.5907   |
| 0.3721        | 15.2145 | 41216 | 0.3791          | 0.2729    | 0.2029 | 0.1977   | 0.5921   |
| 0.3633        | 15.3090 | 41472 | 0.3769          | 0.2706    | 0.2008 | 0.1948   | 0.5897   |
| 0.3635        | 15.4035 | 41728 | 0.3769          | 0.2639    | 0.1962 | 0.1870   | 0.5856   |
| 0.3713        | 15.4980 | 41984 | 0.3803          | 0.2669    | 0.1999 | 0.1909   | 0.5887   |
| 0.3707        | 15.5925 | 42240 | 0.3837          | 0.2673    | 0.2010 | 0.1912   | 0.5869   |
| 0.3618        | 15.6870 | 42496 | 0.3818          | 0.2702    | 0.2014 | 0.1921   | 0.5894   |
| 0.3711        | 15.7815 | 42752 | 0.3770          | 0.2667    | 0.2008 | 0.1944   | 0.5883   |
| 0.3672        | 15.8760 | 43008 | 0.3778          | 0.2651    | 0.2022 | 0.1962   | 0.5880   |
| 0.3659        | 15.9705 | 43264 | 0.3772          | 0.2692    | 0.2016 | 0.1953   | 0.5897   |
| 0.3605        | 16.0650 | 43520 | 0.3804          | 0.2651    | 0.2010 | 0.1927   | 0.5866   |
| 0.3729        | 16.1595 | 43776 | 0.3774          | 0.2681    | 0.2003 | 0.1946   | 0.5880   |
| 0.3668        | 16.2540 | 44032 | 0.3774          | 0.2685    | 0.2002 | 0.1921   | 0.5894   |
| 0.3655        | 16.3485 | 44288 | 0.3763          | 0.2690    | 0.2004 | 0.1947   | 0.5883   |
| 0.3692        | 16.4430 | 44544 | 0.3772          | 0.2667    | 0.2019 | 0.1953   | 0.5887   |
| 0.3651        | 16.5375 | 44800 | 0.3771          | 0.2638    | 0.1998 | 0.1931   | 0.5866   |
| 0.3631        | 16.6320 | 45056 | 0.3791          | 0.2656    | 0.2011 | 0.1938   | 0.5869   |
| 0.3688        | 16.7265 | 45312 | 0.3772          | 0.2657    | 0.1991 | 0.1920   | 0.5869   |
| 0.3748        | 16.8210 | 45568 | 0.3782          | 0.2695    | 0.2006 | 0.1934   | 0.5894   |
| 0.3581        | 16.9155 | 45824 | 0.3772          | 0.2690    | 0.1999 | 0.1929   | 0.5887   |
| 0.36          | 17.0100 | 46080 | 0.3774          | 0.2716    | 0.2008 | 0.1942   | 0.5900   |
| 0.3621        | 17.1045 | 46336 | 0.3768          | 0.2683    | 0.2008 | 0.1946   | 0.5887   |
| 0.3682        | 17.1990 | 46592 | 0.3791          | 0.2676    | 0.2016 | 0.1937   | 0.5894   |
| 0.3687        | 17.2935 | 46848 | 0.3774          | 0.2734    | 0.2020 | 0.1952   | 0.5918   |
| 0.3609        | 17.3880 | 47104 | 0.3765          | 0.2686    | 0.1998 | 0.1932   | 0.5887   |
| 0.369         | 17.4825 | 47360 | 0.3776          | 0.2686    | 0.2007 | 0.1931   | 0.5887   |
| 0.3709        | 17.5770 | 47616 | 0.3775          | 0.2703    | 0.2009 | 0.1930   | 0.5897   |
| 0.3684        | 17.6715 | 47872 | 0.3770          | 0.2675    | 0.2004 | 0.1930   | 0.5883   |
| 0.3612        | 17.7660 | 48128 | 0.3766          | 0.2687    | 0.2012 | 0.1946   | 0.5894   |
| 0.3634        | 17.8605 | 48384 | 0.3774          | 0.2712    | 0.2017 | 0.1946   | 0.5911   |
| 0.3695        | 17.9550 | 48640 | 0.3771          | 0.2724    | 0.2018 | 0.1953   | 0.5911   |
| 0.3578        | 18.0495 | 48896 | 0.3776          | 0.2723    | 0.2028 | 0.1965   | 0.5918   |
| 0.3635        | 18.1440 | 49152 | 0.3769          | 0.2697    | 0.2016 | 0.1957   | 0.5900   |
| 0.3652        | 18.2385 | 49408 | 0.3783          | 0.2671    | 0.2022 | 0.1953   | 0.5890   |
| 0.3734        | 18.3330 | 49664 | 0.3769          | 0.2658    | 0.2002 | 0.1936   | 0.5876   |
| 0.3665        | 18.4275 | 49920 | 0.3768          | 0.2695    | 0.2014 | 0.1951   | 0.5900   |
| 0.3704        | 18.5220 | 50176 | 0.3771          | 0.2703    | 0.2020 | 0.1957   | 0.5907   |
| 0.364         | 18.6165 | 50432 | 0.3770          | 0.2675    | 0.2009 | 0.1940   | 0.5890   |
| 0.3587        | 18.7110 | 50688 | 0.3768          | 0.2678    | 0.1999 | 0.1928   | 0.5887   |
| 0.3622        | 18.8055 | 50944 | 0.3773          | 0.2694    | 0.2012 | 0.1943   | 0.5897   |
| 0.3648        | 18.9000 | 51200 | 0.3773          | 0.2712    | 0.2018 | 0.1953   | 0.5907   |
| 0.3688        | 18.9945 | 51456 | 0.3773          | 0.2700    | 0.2013 | 0.1945   | 0.5900   |
| 0.3638        | 19.0890 | 51712 | 0.3775          | 0.2712    | 0.2014 | 0.1946   | 0.5907   |
| 0.3609        | 19.1835 | 51968 | 0.3773          | 0.2692    | 0.2004 | 0.1933   | 0.5894   |
| 0.3633        | 19.2780 | 52224 | 0.3772          | 0.2693    | 0.2007 | 0.1937   | 0.5897   |
| 0.366         | 19.3725 | 52480 | 0.3772          | 0.2682    | 0.2000 | 0.1928   | 0.5890   |
| 0.365         | 19.4670 | 52736 | 0.3774          | 0.2688    | 0.2003 | 0.1933   | 0.5894   |
| 0.3689        | 19.5615 | 52992 | 0.3769          | 0.2678    | 0.1998 | 0.1926   | 0.5887   |
| 0.3663        | 19.6560 | 53248 | 0.3773          | 0.2704    | 0.2014 | 0.1947   | 0.5904   |
| 0.3712        | 19.7505 | 53504 | 0.3773          | 0.2714    | 0.2015 | 0.1948   | 0.5907   |
| 0.3616        | 19.8450 | 53760 | 0.3773          | 0.2713    | 0.2016 | 0.1949   | 0.5907   |
| 0.369         | 19.9395 | 54016 | 0.3773          | 0.2713    | 0.2016 | 0.1949   | 0.5907   |


### Framework versions

- Transformers 4.43.3
- Pytorch 2.4.0+cu118
- Datasets 2.19.1
- Tokenizers 0.19.1