Theoreticallyhugo commited on
Commit
44a791e
1 Parent(s): 02a6f50

trainer: training complete at 2024-03-04 12:46:48.740510.

Browse files
Files changed (2) hide show
  1. README.md +62 -62
  2. meta_data/README_s42_e50.md +62 -62
README.md CHANGED
@@ -17,12 +17,12 @@ model-index:
17
  name: essays_su_g
18
  type: essays_su_g
19
  config: simple
20
- split: train[60%:80%]
21
  args: simple
22
  metrics:
23
  - name: Accuracy
24
  type: accuracy
25
- value: 0.8617910447761195
26
  ---
27
 
28
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -32,14 +32,14 @@ should probably proofread and complete it, then remove this comment. -->
32
 
33
  This model is a fine-tuned version of [allenai/longformer-base-4096](https://huggingface.co/allenai/longformer-base-4096) on the essays_su_g dataset.
34
  It achieves the following results on the evaluation set:
35
- - Loss: 1.2317
36
- - Claim: {'precision': 0.6477872513195291, 'recall': 0.6459514170040486, 'f1-score': 0.6468680316237584, 'support': 4940.0}
37
- - Majorclaim: {'precision': 0.8505643340857788, 'recall': 0.8610603290676416, 'f1-score': 0.8557801498977969, 'support': 2188.0}
38
- - O: {'precision': 0.926710256660486, 'recall': 0.9067124988064547, 'f1-score': 0.9166023166023166, 'support': 10473.0}
39
- - Premise: {'precision': 0.8874751737835154, 'recall': 0.8993647399207497, 'f1-score': 0.8933804004873324, 'support': 15899.0}
40
- - Accuracy: 0.8618
41
- - Macro avg: {'precision': 0.8281342539623273, 'recall': 0.8282722461997236, 'f1-score': 0.828157724652801, 'support': 33500.0}
42
- - Weighted avg: {'precision': 0.8619853161339563, 'recall': 0.8617910447761195, 'f1-score': 0.8618330177111018, 'support': 33500.0}
43
 
44
  ## Model description
45
 
@@ -68,58 +68,58 @@ The following hyperparameters were used during training:
68
 
69
  ### Training results
70
 
71
- | Training Loss | Epoch | Step | Validation Loss | Claim | Majorclaim | O | Premise | Accuracy | Macro avg | Weighted avg |
72
- |:-------------:|:-----:|:----:|:---------------:|:-------------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|:--------:|:-------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|
73
- | No log | 1.0 | 81 | 0.4981 | {'precision': 0.6228840125391849, 'recall': 0.40222672064777326, 'f1-score': 0.4888068880688806, 'support': 4940.0} | {'precision': 0.7604525332021643, 'recall': 0.706581352833638, 'f1-score': 0.7325278370054489, 'support': 2188.0} | {'precision': 0.827613377692173, 'recall': 0.902606702950444, 'f1-score': 0.8634848138844484, 'support': 10473.0} | {'precision': 0.8543458914268763, 'recall': 0.9057173407132524, 'f1-score': 0.8792819197655248, 'support': 15899.0} | 0.8175 | {'precision': 0.7663239537150996, 'recall': 0.7292830292862769, 'f1-score': 0.7410253646810757, 'support': 33500.0} | {'precision': 0.80572410140167, 'recall': 0.8174925373134329, 'f1-score': 0.8071778099281224, 'support': 33500.0} |
74
- | No log | 2.0 | 162 | 0.4563 | {'precision': 0.6593780369290574, 'recall': 0.5493927125506073, 'f1-score': 0.5993816254416962, 'support': 4940.0} | {'precision': 0.7197382769901853, 'recall': 0.9049360146252285, 'f1-score': 0.8017817371937639, 'support': 2188.0} | {'precision': 0.9337184554575859, 'recall': 0.8796906330564308, 'f1-score': 0.9058997050147494, 'support': 10473.0} | {'precision': 0.862579028987236, 'recall': 0.9096169570413234, 'f1-score': 0.8854737486606459, 'support': 15899.0} | 0.8468 | {'precision': 0.7938534495910161, 'recall': 0.8109090793183975, 'f1-score': 0.7981342040777137, 'support': 33500.0} | {'precision': 0.8455251408465503, 'recall': 0.8468358208955223, 'f1-score': 0.8442053257085675, 'support': 33500.0} |
75
- | No log | 3.0 | 243 | 0.4382 | {'precision': 0.6285479226655697, 'recall': 0.6186234817813765, 'f1-score': 0.6235462150581514, 'support': 4940.0} | {'precision': 0.8059701492537313, 'recall': 0.8638025594149908, 'f1-score': 0.8338848444738584, 'support': 2188.0} | {'precision': 0.8974646833193002, 'recall': 0.9159744103886184, 'f1-score': 0.9066250826953974, 'support': 10473.0} | {'precision': 0.8911176621379133, 'recall': 0.8745833071262343, 'f1-score': 0.8827730692315017, 'support': 15899.0} | 0.8491 | {'precision': 0.8057751043441286, 'recall': 0.818245939677805, 'f1-score': 0.8117073028647273, 'support': 33500.0} | {'precision': 0.8488213959184715, 'recall': 0.8490746268656716, 'f1-score': 0.8488105033097496, 'support': 33500.0} |
76
- | No log | 4.0 | 324 | 0.4750 | {'precision': 0.6477507222451506, 'recall': 0.6354251012145749, 'f1-score': 0.6415287144900879, 'support': 4940.0} | {'precision': 0.7514033680834001, 'recall': 0.856489945155393, 'f1-score': 0.8005126014523707, 'support': 2188.0} | {'precision': 0.9273871354374751, 'recall': 0.8865654540246348, 'f1-score': 0.9065169636319258, 'support': 10473.0} | {'precision': 0.8863636363636364, 'recall': 0.9002452984464432, 'f1-score': 0.8932505382719131, 'support': 15899.0} | 0.8541 | {'precision': 0.8032262155324155, 'recall': 0.8196814497102615, 'f1-score': 0.8104522044615743, 'support': 33500.0} | {'precision': 0.8551874645146165, 'recall': 0.8540597014925373, 'f1-score': 0.8542213698406307, 'support': 33500.0} |
77
- | No log | 5.0 | 405 | 0.5162 | {'precision': 0.6808882235528942, 'recall': 0.5524291497975709, 'f1-score': 0.6099687080911935, 'support': 4940.0} | {'precision': 0.8330275229357799, 'recall': 0.829981718464351, 'f1-score': 0.8315018315018317, 'support': 2188.0} | {'precision': 0.9074091642159188, 'recall': 0.9133008689009835, 'f1-score': 0.9103454839630722, 'support': 10473.0} | {'precision': 0.8682249120505635, 'recall': 0.915843763758727, 'f1-score': 0.8913988368533824, 'support': 15899.0} | 0.8559 | {'precision': 0.8223874556887891, 'recall': 0.8028888752304081, 'f1-score': 0.8108037151023699, 'support': 33500.0} | {'precision': 0.8505509283002989, 'recall': 0.8558507462686568, 'f1-score': 0.8519095458499607, 'support': 33500.0} |
78
- | No log | 6.0 | 486 | 0.5529 | {'precision': 0.6227477477477478, 'recall': 0.6716599190283401, 'f1-score': 0.646279703934554, 'support': 4940.0} | {'precision': 0.8152593227603944, 'recall': 0.8692870201096892, 'f1-score': 0.8414067684140676, 'support': 2188.0} | {'precision': 0.9295788637266588, 'recall': 0.8936312422419556, 'f1-score': 0.9112506693929215, 'support': 10473.0} | {'precision': 0.8897343224906474, 'recall': 0.8825712308950249, 'f1-score': 0.8861383012314494, 'support': 15899.0} | 0.8541 | {'precision': 0.8143300641813621, 'recall': 0.8292873530687525, 'f1-score': 0.8212688607432481, 'support': 33500.0} | {'precision': 0.8579560210496036, 'recall': 0.8540597014925373, 'f1-score': 0.8556973390614198, 'support': 33500.0} |
79
- | 0.3328 | 7.0 | 567 | 0.5894 | {'precision': 0.6739491807171694, 'recall': 0.5744939271255061, 'f1-score': 0.6202600808654791, 'support': 4940.0} | {'precision': 0.8730305838739574, 'recall': 0.8610603290676416, 'f1-score': 0.8670041417395307, 'support': 2188.0} | {'precision': 0.9097314797181489, 'recall': 0.9122505490308412, 'f1-score': 0.9109892729439809, 'support': 10473.0} | {'precision': 0.8677611401767996, 'recall': 0.9076042518397384, 'f1-score': 0.8872356123954747, 'support': 15899.0} | 0.8569 | {'precision': 0.8311180961215189, 'recall': 0.8138522642659318, 'f1-score': 0.8213722769861164, 'support': 33500.0} | {'precision': 0.8526463291050193, 'recall': 0.8568955223880597, 'f1-score': 0.8539713289140156, 'support': 33500.0} |
80
- | 0.3328 | 8.0 | 648 | 0.5878 | {'precision': 0.5974385600553825, 'recall': 0.6987854251012146, 'f1-score': 0.6441500279902966, 'support': 4940.0} | {'precision': 0.7849375755134917, 'recall': 0.8907678244972578, 'f1-score': 0.834510811389424, 'support': 2188.0} | {'precision': 0.9398542543364466, 'recall': 0.874343550081161, 'f1-score': 0.9059161060546101, 'support': 10473.0} | {'precision': 0.8915849251419721, 'recall': 0.8689854707843261, 'f1-score': 0.8801401497053671, 'support': 15899.0} | 0.8470 | {'precision': 0.8034538287618231, 'recall': 0.8332205676159898, 'f1-score': 0.8161792737849245, 'support': 33500.0} | {'precision': 0.8563340964894008, 'recall': 0.8469850746268657, 'f1-score': 0.8504184600736624, 'support': 33500.0} |
81
- | 0.3328 | 9.0 | 729 | 0.7043 | {'precision': 0.6375797489195307, 'recall': 0.6271255060728745, 'f1-score': 0.6323094193285029, 'support': 4940.0} | {'precision': 0.8373732921992068, 'recall': 0.8683729433272395, 'f1-score': 0.8525914292124747, 'support': 2188.0} | {'precision': 0.9134194927606647, 'recall': 0.8975460708488494, 'f1-score': 0.9054132151801194, 'support': 10473.0} | {'precision': 0.883775884584292, 'recall': 0.8938926976539405, 'f1-score': 0.8888055034396498, 'support': 15899.0} | 0.8540 | {'precision': 0.8180371046159236, 'recall': 0.821734304475726, 'f1-score': 0.8197798917901866, 'support': 33500.0} | {'precision': 0.8537078167069386, 'recall': 0.8540298507462687, 'f1-score': 0.853808653145316, 'support': 33500.0} |
82
- | 0.3328 | 10.0 | 810 | 0.7164 | {'precision': 0.6368453230079478, 'recall': 0.6325910931174089, 'f1-score': 0.6347110795166041, 'support': 4940.0} | {'precision': 0.8921119592875318, 'recall': 0.8011882998171846, 'f1-score': 0.8442090055381651, 'support': 2188.0} | {'precision': 0.9040270982310877, 'recall': 0.9174066647569942, 'f1-score': 0.9106677408653618, 'support': 10473.0} | {'precision': 0.881375, 'recall': 0.8869740235234921, 'f1-score': 0.8841656478259506, 'support': 15899.0} | 0.8534 | {'precision': 0.8285898451316418, 'recall': 0.8095400203037699, 'f1-score': 0.8184383684365204, 'support': 33500.0} | {'precision': 0.8530989190255094, 'recall': 0.8533731343283583, 'f1-score': 0.8530559678148433, 'support': 33500.0} |
83
- | 0.3328 | 11.0 | 891 | 0.7852 | {'precision': 0.6161486113665624, 'recall': 0.6781376518218624, 'f1-score': 0.645658668208538, 'support': 4940.0} | {'precision': 0.7885714285714286, 'recall': 0.8829981718464351, 'f1-score': 0.8331177231565331, 'support': 2188.0} | {'precision': 0.9366843393148451, 'recall': 0.8772080588179128, 'f1-score': 0.9059711059612445, 'support': 10473.0} | {'precision': 0.8929452704840241, 'recall': 0.8876658909365369, 'f1-score': 0.8902977542265961, 'support': 15899.0} | 0.8532 | {'precision': 0.8085874124342151, 'recall': 0.8315024433556868, 'f1-score': 0.818761312888228, 'support': 33500.0} | {'precision': 0.8589850855801485, 'recall': 0.8531940298507462, 'f1-score': 0.8553879040715653, 'support': 33500.0} |
84
- | 0.3328 | 12.0 | 972 | 0.8325 | {'precision': 0.6280645804265498, 'recall': 0.6378542510121458, 'f1-score': 0.6329215627196947, 'support': 4940.0} | {'precision': 0.8278829604130808, 'recall': 0.8793418647166362, 'f1-score': 0.8528368794326241, 'support': 2188.0} | {'precision': 0.9193064031773709, 'recall': 0.9061395970591044, 'f1-score': 0.9126755145220234, 'support': 10473.0} | {'precision': 0.8894291487749432, 'recall': 0.88590477388515, 'f1-score': 0.8876634630534112, 'support': 15899.0} | 0.8552 | {'precision': 0.8161707731979861, 'recall': 0.827310121668259, 'f1-score': 0.8215243549319383, 'support': 33500.0} | {'precision': 0.8562082669116539, 'recall': 0.8552238805970149, 'f1-score': 0.8556433335734092, 'support': 33500.0} |
85
- | 0.0589 | 13.0 | 1053 | 0.8543 | {'precision': 0.6377388535031847, 'recall': 0.648582995951417, 'f1-score': 0.6431152147731835, 'support': 4940.0} | {'precision': 0.8206835330670218, 'recall': 0.8450639853747715, 'f1-score': 0.8326953388876379, 'support': 2188.0} | {'precision': 0.9408790755262072, 'recall': 0.8707151723479424, 'f1-score': 0.904438383337466, 'support': 10473.0} | {'precision': 0.8749621922448733, 'recall': 0.9097427511164224, 'f1-score': 0.892013567684243, 'support': 15899.0} | 0.8548 | {'precision': 0.8185659135853218, 'recall': 0.8185262261976383, 'f1-score': 0.8180656261706326, 'support': 33500.0} | {'precision': 0.8570428644520474, 'recall': 0.8548059701492537, 'f1-score': 0.8553204019036041, 'support': 33500.0} |
86
- | 0.0589 | 14.0 | 1134 | 0.9095 | {'precision': 0.6138420585625555, 'recall': 0.7002024291497976, 'f1-score': 0.6541843971631205, 'support': 4940.0} | {'precision': 0.7806142800159553, 'recall': 0.8944241316270567, 'f1-score': 0.8336528221512247, 'support': 2188.0} | {'precision': 0.9421004003695719, 'recall': 0.8762532225723288, 'f1-score': 0.9079845651528643, 'support': 10473.0} | {'precision': 0.8974194787731319, 'recall': 0.8815019812566828, 'f1-score': 0.889389516436096, 'support': 15899.0} | 0.8540 | {'precision': 0.8084940544303038, 'recall': 0.8380954411514664, 'f1-score': 0.8213028252258264, 'support': 33500.0} | {'precision': 0.8619418985092084, 'recall': 0.8539701492537314, 'f1-score': 0.8568784946124219, 'support': 33500.0} |
87
- | 0.0589 | 15.0 | 1215 | 0.9577 | {'precision': 0.6332046332046332, 'recall': 0.6307692307692307, 'f1-score': 0.631984585741811, 'support': 4940.0} | {'precision': 0.7778225806451613, 'recall': 0.8816270566727605, 'f1-score': 0.8264781491002571, 'support': 2188.0} | {'precision': 0.8886910896655111, 'recall': 0.9056621789363124, 'f1-score': 0.8970963775654971, 'support': 10473.0} | {'precision': 0.8974458706080644, 'recall': 0.8707465878357129, 'f1-score': 0.8838946528332003, 'support': 15899.0} | 0.8470 | {'precision': 0.7992910435308425, 'recall': 0.8222012635535042, 'f1-score': 0.8098634413101913, 'support': 33500.0} | {'precision': 0.8479301603984184, 'recall': 0.8469850746268657, 'f1-score': 0.8471244624308779, 'support': 33500.0} |
88
- | 0.0589 | 16.0 | 1296 | 0.9395 | {'precision': 0.6682400539447066, 'recall': 0.6018218623481781, 'f1-score': 0.6332942805410586, 'support': 4940.0} | {'precision': 0.8464692482915718, 'recall': 0.8491773308957953, 'f1-score': 0.8478211270819075, 'support': 2188.0} | {'precision': 0.9145563502803016, 'recall': 0.9034660555714695, 'f1-score': 0.9089773764349872, 'support': 10473.0} | {'precision': 0.8759539672925499, 'recall': 0.9096169570413234, 'f1-score': 0.8924681415656145, 'support': 15899.0} | 0.8584 | {'precision': 0.8263049049522826, 'recall': 0.8160205514641916, 'f1-score': 0.8206402314058919, 'support': 33500.0} | {'precision': 0.8554663093796615, 'recall': 0.8583582089552239, 'f1-score': 0.8564948483009961, 'support': 33500.0} |
89
- | 0.0589 | 17.0 | 1377 | 0.9581 | {'precision': 0.6657279029462738, 'recall': 0.6220647773279352, 'f1-score': 0.6431561322729175, 'support': 4940.0} | {'precision': 0.8350423539901917, 'recall': 0.8560329067641682, 'f1-score': 0.8454073572556984, 'support': 2188.0} | {'precision': 0.9241991128634796, 'recall': 0.8952544638594481, 'f1-score': 0.909496556407023, 'support': 10473.0} | {'precision': 0.8791828322017459, 'recall': 0.9121957355808541, 'f1-score': 0.8953850902917116, 'support': 15899.0} | 0.8604 | {'precision': 0.8260380505004228, 'recall': 0.8213869708831014, 'f1-score': 0.8233612840568376, 'support': 33500.0} | {'precision': 0.8588965274411914, 'recall': 0.8604477611940299, 'f1-score': 0.859338136623951, 'support': 33500.0} |
90
- | 0.0589 | 18.0 | 1458 | 0.9848 | {'precision': 0.632508155824218, 'recall': 0.6672064777327935, 'f1-score': 0.6493941483597675, 'support': 4940.0} | {'precision': 0.8635122838944495, 'recall': 0.8674588665447898, 'f1-score': 0.8654810761513908, 'support': 2188.0} | {'precision': 0.9323503038756601, 'recall': 0.8935357586173971, 'f1-score': 0.9125304729400293, 'support': 10473.0} | {'precision': 0.8885635978572318, 'recall': 0.8972262406440656, 'f1-score': 0.8928739085531874, 'support': 15899.0} | 0.8602 | {'precision': 0.8292335853628898, 'recall': 0.8313568358847614, 'f1-score': 0.8300699015010937, 'support': 33500.0} | {'precision': 0.8628576878135704, 'recall': 0.8602089552238806, 'f1-score': 0.8613257791852104, 'support': 33500.0} |
91
- | 0.0216 | 19.0 | 1539 | 1.0161 | {'precision': 0.6432509699816213, 'recall': 0.6376518218623481, 'f1-score': 0.6404391582799633, 'support': 4940.0} | {'precision': 0.8103975535168195, 'recall': 0.8478062157221207, 'f1-score': 0.8286799195890104, 'support': 2188.0} | {'precision': 0.9029750479846449, 'recall': 0.898405423469875, 'f1-score': 0.9006844397645144, 'support': 10473.0} | {'precision': 0.8907763936076507, 'recall': 0.8904962576262658, 'f1-score': 0.8906363035888403, 'support': 15899.0} | 0.8529 | {'precision': 0.8118499912726841, 'recall': 0.8185899296701524, 'f1-score': 0.8151099553055821, 'support': 33500.0} | {'precision': 0.8528394387556787, 'recall': 0.8528955223880597, 'f1-score': 0.8528362935634777, 'support': 33500.0} |
92
- | 0.0216 | 20.0 | 1620 | 0.9873 | {'precision': 0.6603498542274052, 'recall': 0.6419028340080971, 'f1-score': 0.650995688770273, 'support': 4940.0} | {'precision': 0.8447589562140646, 'recall': 0.8729433272394881, 'f1-score': 0.8586199145875477, 'support': 2188.0} | {'precision': 0.913972286374134, 'recall': 0.9069034660555715, 'f1-score': 0.9104241552839684, 'support': 10473.0} | {'precision': 0.8866313493300093, 'recall': 0.894773256179634, 'f1-score': 0.8906836964688204, 'support': 15899.0} | 0.8599 | {'precision': 0.8264281115364033, 'recall': 0.8291307208706977, 'f1-score': 0.8276808637776524, 'support': 33500.0} | {'precision': 0.8590759538589217, 'recall': 0.8598507462686568, 'f1-score': 0.8594158610175964, 'support': 33500.0} |
93
- | 0.0216 | 21.0 | 1701 | 1.0280 | {'precision': 0.6169108103096607, 'recall': 0.6734817813765183, 'f1-score': 0.6439562566534404, 'support': 4940.0} | {'precision': 0.8370044052863436, 'recall': 0.8683729433272395, 'f1-score': 0.8524001794526693, 'support': 2188.0} | {'precision': 0.9311383256374222, 'recall': 0.8857061014036093, 'f1-score': 0.9078541717641301, 'support': 10473.0} | {'precision': 0.8857952755905512, 'recall': 0.8844581420215107, 'f1-score': 0.8851262038144394, 'support': 15899.0} | 0.8527 | {'precision': 0.8177122042059943, 'recall': 0.8280047420322194, 'f1-score': 0.8223342029211698, 'support': 33500.0} | {'precision': 0.8571336063495862, 'recall': 0.8526865671641791, 'f1-score': 0.8545305598758789, 'support': 33500.0} |
94
- | 0.0216 | 22.0 | 1782 | 1.0620 | {'precision': 0.6779808529155787, 'recall': 0.6307692307692307, 'f1-score': 0.6535234899328859, 'support': 4940.0} | {'precision': 0.8341377797279509, 'recall': 0.8688299817184644, 'f1-score': 0.8511305126483099, 'support': 2188.0} | {'precision': 0.9212073696589572, 'recall': 0.8975460708488494, 'f1-score': 0.9092228079508632, 'support': 10473.0} | {'precision': 0.882589367273613, 'recall': 0.9115667652053588, 'f1-score': 0.8968440594059406, 'support': 15899.0} | 0.8630 | {'precision': 0.828978842394025, 'recall': 0.8271780121354758, 'f1-score': 0.8276802174844999, 'support': 33500.0} | {'precision': 0.8613257315871389, 'recall': 0.8629850746268657, 'f1-score': 0.8618475752270865, 'support': 33500.0} |
95
- | 0.0216 | 23.0 | 1863 | 1.1896 | {'precision': 0.5858518764530056, 'recall': 0.71417004048583, 'f1-score': 0.6436781609195402, 'support': 4940.0} | {'precision': 0.8349056603773585, 'recall': 0.8898537477148081, 'f1-score': 0.8615044247787611, 'support': 2188.0} | {'precision': 0.9129765113592607, 'recall': 0.905566695311754, 'f1-score': 0.9092565073582283, 'support': 10473.0} | {'precision': 0.9069657135113159, 'recall': 0.841876847600478, 'f1-score': 0.873210033597547, 'support': 15899.0} | 0.8461 | {'precision': 0.8101749404252352, 'recall': 0.8378668327782175, 'f1-score': 0.8219122816635192, 'support': 33500.0} | {'precision': 0.8567860518556853, 'recall': 0.846089552238806, 'f1-score': 0.8498672096145845, 'support': 33500.0} |
96
- | 0.0216 | 24.0 | 1944 | 1.1086 | {'precision': 0.6551451708473237, 'recall': 0.6714574898785425, 'f1-score': 0.6632010396880935, 'support': 4940.0} | {'precision': 0.8465414567109483, 'recall': 0.8446069469835467, 'f1-score': 0.84557309540151, 'support': 2188.0} | {'precision': 0.922805987672439, 'recall': 0.9006015468347178, 'f1-score': 0.911568570600174, 'support': 10473.0} | {'precision': 0.8933449759870268, 'recall': 0.9008742688219384, 'f1-score': 0.8970938243768007, 'support': 15899.0} | 0.8633 | {'precision': 0.8294593978044343, 'recall': 0.8293850631296864, 'f1-score': 0.8293591325166445, 'support': 33500.0} | {'precision': 0.864372798011359, 'recall': 0.8632835820895522, 'f1-score': 0.8637635648495541, 'support': 33500.0} |
97
- | 0.0102 | 25.0 | 2025 | 1.0723 | {'precision': 0.6391891891891892, 'recall': 0.6702429149797571, 'f1-score': 0.6543478260869565, 'support': 4940.0} | {'precision': 0.8314757021845742, 'recall': 0.8523765996343693, 'f1-score': 0.8417964342134958, 'support': 2188.0} | {'precision': 0.9285072391412881, 'recall': 0.8879022247684523, 'f1-score': 0.9077508785630614, 'support': 10473.0} | {'precision': 0.884198729921554, 'recall': 0.8932637272784452, 'f1-score': 0.8887081130127343, 'support': 15899.0} | 0.8560 | {'precision': 0.8208427151091513, 'recall': 0.8259463666652559, 'f1-score': 0.8231508129690621, 'support': 33500.0} | {'precision': 0.8584774732395206, 'recall': 0.8560298507462687, 'f1-score': 0.8570380328032566, 'support': 33500.0} |
98
- | 0.0102 | 26.0 | 2106 | 1.1268 | {'precision': 0.636963696369637, 'recall': 0.66417004048583, 'f1-score': 0.6502824298880191, 'support': 4940.0} | {'precision': 0.8252173913043478, 'recall': 0.8674588665447898, 'f1-score': 0.8458110516934045, 'support': 2188.0} | {'precision': 0.9229943392543432, 'recall': 0.9029886374486775, 'f1-score': 0.912881895844394, 'support': 10473.0} | {'precision': 0.8905271151047269, 'recall': 0.8851500094345557, 'f1-score': 0.8878304207936407, 'support': 15899.0} | 0.8570 | {'precision': 0.8189256355082637, 'recall': 0.8299418884784633, 'f1-score': 0.8242014495548646, 'support': 33500.0} | {'precision': 0.8590204964268868, 'recall': 0.8569850746268657, 'f1-score': 0.8578882907501019, 'support': 33500.0} |
99
- | 0.0102 | 27.0 | 2187 | 1.1018 | {'precision': 0.6353259818146644, 'recall': 0.6647773279352227, 'f1-score': 0.6497180730042537, 'support': 4940.0} | {'precision': 0.8737251092763477, 'recall': 0.8222120658135283, 'f1-score': 0.8471862491170237, 'support': 2188.0} | {'precision': 0.9107074569789675, 'recall': 0.9095770075432064, 'f1-score': 0.9101418812401472, 'support': 10473.0} | {'precision': 0.8921072603086264, 'recall': 0.8872256116736902, 'f1-score': 0.889659739522563, 'support': 15899.0} | 0.8572 | {'precision': 0.8279664520946515, 'recall': 0.8209480032414119, 'f1-score': 0.824176485720997, 'support': 33500.0} | {'precision': 0.8588559229208557, 'recall': 0.8571641791044776, 'f1-score': 0.8579064750628762, 'support': 33500.0} |
100
- | 0.0102 | 28.0 | 2268 | 1.0291 | {'precision': 0.6845411711913844, 'recall': 0.6176113360323887, 'f1-score': 0.6493561775034585, 'support': 4940.0} | {'precision': 0.8403058929374719, 'recall': 0.8537477148080439, 'f1-score': 0.846973475402403, 'support': 2188.0} | {'precision': 0.9202835226721041, 'recall': 0.9049937935644037, 'f1-score': 0.9125746196803388, 'support': 10473.0} | {'precision': 0.8788814236426367, 'recall': 0.9132649852191962, 'f1-score': 0.8957433682911783, 'support': 15899.0} | 0.8632 | {'precision': 0.8310030026108993, 'recall': 0.8224044574060082, 'f1-score': 0.8261619102193447, 'support': 33500.0} | {'precision': 0.8606473960260256, 'recall': 0.8631940298507462, 'f1-score': 0.8614870234454082, 'support': 33500.0} |
101
- | 0.0102 | 29.0 | 2349 | 1.1137 | {'precision': 0.6787787572565039, 'recall': 0.6390688259109312, 'f1-score': 0.6583255135022417, 'support': 4940.0} | {'precision': 0.8508211678832117, 'recall': 0.8523765996343693, 'f1-score': 0.8515981735159819, 'support': 2188.0} | {'precision': 0.916385704652731, 'recall': 0.9083357204239473, 'f1-score': 0.9123429557878584, 'support': 10473.0} | {'precision': 0.8844310641435242, 'recall': 0.9054028555255047, 'f1-score': 0.8947940947940948, 'support': 15899.0} | 0.8636 | {'precision': 0.8326041734839926, 'recall': 0.8262960003736881, 'f1-score': 0.8292651844000442, 'support': 33500.0} | {'precision': 0.8618997238752699, 'recall': 0.8635820895522388, 'f1-score': 0.8625887740134804, 'support': 33500.0} |
102
- | 0.0102 | 30.0 | 2430 | 1.1232 | {'precision': 0.677736508630107, 'recall': 0.6279352226720648, 'f1-score': 0.6518860985604706, 'support': 4940.0} | {'precision': 0.8508412914961346, 'recall': 0.8551188299817185, 'f1-score': 0.8529746979712788, 'support': 2188.0} | {'precision': 0.919930035953746, 'recall': 0.9039434736942614, 'f1-score': 0.911866692352148, 'support': 10473.0} | {'precision': 0.8810929227773383, 'recall': 0.9106862066796654, 'f1-score': 0.8956451812445873, 'support': 15899.0} | 0.8633 | {'precision': 0.8324001897143315, 'recall': 0.8244209332569276, 'f1-score': 0.8280931675321211, 'support': 33500.0} | {'precision': 0.8612711266927389, 'recall': 0.8632537313432835, 'f1-score': 0.8619841364675112, 'support': 33500.0} |
103
- | 0.0075 | 31.0 | 2511 | 1.1208 | {'precision': 0.6758557316793017, 'recall': 0.5955465587044534, 'f1-score': 0.6331647476595287, 'support': 4940.0} | {'precision': 0.8557603686635945, 'recall': 0.8487202925045704, 'f1-score': 0.8522257916475449, 'support': 2188.0} | {'precision': 0.928901109692625, 'recall': 0.9031796046977943, 'f1-score': 0.9158597986057321, 'support': 10473.0} | {'precision': 0.8695962843872812, 'recall': 0.9185483363733569, 'f1-score': 0.8934022573639618, 'support': 15899.0} | 0.8616 | {'precision': 0.8325283736057006, 'recall': 0.8164986980700437, 'f1-score': 0.8236631488191918, 'support': 33500.0} | {'precision': 0.858663392490028, 'recall': 0.8615522388059701, 'f1-score': 0.8593583894385183, 'support': 33500.0} |
104
- | 0.0075 | 32.0 | 2592 | 1.1111 | {'precision': 0.6402947450067868, 'recall': 0.6684210526315789, 'f1-score': 0.6540556600970584, 'support': 4940.0} | {'precision': 0.8271230502599654, 'recall': 0.8724862888482633, 'f1-score': 0.8491992882562277, 'support': 2188.0} | {'precision': 0.934014685453463, 'recall': 0.8987873579681085, 'f1-score': 0.9160624787114983, 'support': 10473.0} | {'precision': 0.8899542520523908, 'recall': 0.8932008302408957, 'f1-score': 0.8915745856353591, 'support': 15899.0} | 0.8604 | {'precision': 0.8228466831931516, 'recall': 0.8332238824222116, 'f1-score': 0.8277230031750359, 'support': 33500.0} | {'precision': 0.8628095441324599, 'recall': 0.8604477611940299, 'f1-score': 0.8614373038849609, 'support': 33500.0} |
105
- | 0.0075 | 33.0 | 2673 | 1.1452 | {'precision': 0.6549778315195486, 'recall': 0.6578947368421053, 'f1-score': 0.6564330438295295, 'support': 4940.0} | {'precision': 0.8285214348206474, 'recall': 0.8656307129798904, 'f1-score': 0.8466696468484577, 'support': 2188.0} | {'precision': 0.9282555282555283, 'recall': 0.9018428339539769, 'f1-score': 0.9148585819449826, 'support': 10473.0} | {'precision': 0.8899048329912297, 'recall': 0.899867916221146, 'f1-score': 0.8948586439829872, 'support': 15899.0} | 0.8626 | {'precision': 0.8254149068967386, 'recall': 0.8313090499992797, 'f1-score': 0.8282049791514892, 'support': 33500.0} | {'precision': 0.8632421634102047, 'recall': 0.8625671641791045, 'f1-score': 0.862804893528884, 'support': 33500.0} |
106
- | 0.0075 | 34.0 | 2754 | 1.1328 | {'precision': 0.6835973904939422, 'recall': 0.5939271255060729, 'f1-score': 0.6356152512998267, 'support': 4940.0} | {'precision': 0.8433895297249334, 'recall': 0.8688299817184644, 'f1-score': 0.8559207564160288, 'support': 2188.0} | {'precision': 0.9166907444861794, 'recall': 0.9088131385467393, 'f1-score': 0.9127349443805141, 'support': 10473.0} | {'precision': 0.876591635990586, 'recall': 0.9136423674444933, 'f1-score': 0.8947336002463814, 'support': 15899.0} | 0.8621 | {'precision': 0.8300673251739102, 'recall': 0.8213031533039424, 'f1-score': 0.8247511380856878, 'support': 33500.0} | {'precision': 0.858499701125263, 'recall': 0.8620597014925373, 'f1-score': 0.8596160160977241, 'support': 33500.0} |
107
- | 0.0075 | 35.0 | 2835 | 1.1654 | {'precision': 0.6584344914190038, 'recall': 0.6368421052631579, 'f1-score': 0.6474583247581807, 'support': 4940.0} | {'precision': 0.8545966228893058, 'recall': 0.8327239488117002, 'f1-score': 0.8435185185185186, 'support': 2188.0} | {'precision': 0.9174373795761079, 'recall': 0.9092905566695312, 'f1-score': 0.9133458015633241, 'support': 10473.0} | {'precision': 0.8844540407156076, 'recall': 0.9017548273476319, 'f1-score': 0.8930206484163319, 'support': 15899.0} | 0.8605 | {'precision': 0.8287306336500063, 'recall': 0.8201528595230052, 'f1-score': 0.8243358233140887, 'support': 33500.0} | {'precision': 0.8594859781531254, 'recall': 0.8605373134328358, 'f1-score': 0.8599304033363548, 'support': 33500.0} |
108
- | 0.0075 | 36.0 | 2916 | 1.1980 | {'precision': 0.654320987654321, 'recall': 0.6115384615384616, 'f1-score': 0.63220675944334, 'support': 4940.0} | {'precision': 0.8379814077025233, 'recall': 0.8651736745886655, 'f1-score': 0.8513604677310547, 'support': 2188.0} | {'precision': 0.9262343260188087, 'recall': 0.9027976701995608, 'f1-score': 0.9143658430443401, 'support': 10473.0} | {'precision': 0.8778021442495126, 'recall': 0.9063463110887477, 'f1-score': 0.8918458920006188, 'support': 15899.0} | 0.8591 | {'precision': 0.8240847164062914, 'recall': 0.8214640293538589, 'f1-score': 0.8224447405548384, 'support': 33500.0} | {'precision': 0.8573873846830882, 'recall': 0.8590746268656716, 'f1-score': 0.857954907646772, 'support': 33500.0} |
109
- | 0.0075 | 37.0 | 2997 | 1.1902 | {'precision': 0.6605045672031318, 'recall': 0.6147773279352227, 'f1-score': 0.6368211365066052, 'support': 4940.0} | {'precision': 0.8536474852741278, 'recall': 0.8610603290676416, 'f1-score': 0.8573378839590444, 'support': 2188.0} | {'precision': 0.9250779423226813, 'recall': 0.9066170151818963, 'f1-score': 0.9157544485701886, 'support': 10473.0} | {'precision': 0.8778528391455176, 'recall': 0.9072268696144412, 'f1-score': 0.8922981750695949, 'support': 15899.0} | 0.8609 | {'precision': 0.8292707084863646, 'recall': 0.8224203854498005, 'f1-score': 0.8255529110263582, 'support': 33500.0} | {'precision': 0.8589849802771131, 'recall': 0.8608955223880597, 'f1-score': 0.859674529246331, 'support': 33500.0} |
110
- | 0.0042 | 38.0 | 3078 | 1.1981 | {'precision': 0.6303837118245889, 'recall': 0.6518218623481782, 'f1-score': 0.6409235668789809, 'support': 4940.0} | {'precision': 0.8486633439057544, 'recall': 0.8560329067641682, 'f1-score': 0.8523321956769055, 'support': 2188.0} | {'precision': 0.9275547266123491, 'recall': 0.9022247684522104, 'f1-score': 0.9147144240077445, 'support': 10473.0} | {'precision': 0.8876734591823978, 'recall': 0.8932008302408957, 'f1-score': 0.8904285669498698, 'support': 15899.0} | 0.858 | {'precision': 0.8235688103812725, 'recall': 0.8258200919513632, 'f1-score': 0.8245996883783752, 'support': 33500.0} | {'precision': 0.8596528929024279, 'recall': 0.858, 'f1-score': 0.8587400959132037, 'support': 33500.0} |
111
- | 0.0042 | 39.0 | 3159 | 1.2141 | {'precision': 0.6662414965986394, 'recall': 0.6344129554655871, 'f1-score': 0.6499377851513894, 'support': 4940.0} | {'precision': 0.8540315106580166, 'recall': 0.8423217550274223, 'f1-score': 0.8481362172112287, 'support': 2188.0} | {'precision': 0.9111302023673158, 'recall': 0.9113911964098157, 'f1-score': 0.9112606807007495, 'support': 10473.0} | {'precision': 0.8855958420987502, 'recall': 0.9002452984464432, 'f1-score': 0.8928604847010387, 'support': 15899.0} | 0.8607 | {'precision': 0.8292497629306805, 'recall': 0.822092801337317, 'f1-score': 0.8255487919411015, 'support': 33500.0} | {'precision': 0.8591704131772522, 'recall': 0.8607462686567164, 'f1-score': 0.8598697509596058, 'support': 33500.0} |
112
- | 0.0042 | 40.0 | 3240 | 1.2188 | {'precision': 0.6613790186125211, 'recall': 0.632995951417004, 'f1-score': 0.6468762929251138, 'support': 4940.0} | {'precision': 0.8279290964115866, 'recall': 0.8752285191956124, 'f1-score': 0.8509220173294822, 'support': 2188.0} | {'precision': 0.921379980563654, 'recall': 0.9052802444380789, 'f1-score': 0.9132591629340654, 'support': 10473.0} | {'precision': 0.8843465891520812, 'recall': 0.8993647399207497, 'f1-score': 0.8917924410627417, 'support': 15899.0} | 0.8604 | {'precision': 0.8237586711849608, 'recall': 0.8282173637428613, 'f1-score': 0.8257124785628508, 'support': 33500.0} | {'precision': 0.8593600051422834, 'recall': 0.8603582089552239, 'f1-score': 0.8597181341740886, 'support': 33500.0} |
113
- | 0.0042 | 41.0 | 3321 | 1.1967 | {'precision': 0.6519950637597697, 'recall': 0.6417004048582996, 'f1-score': 0.646806774127729, 'support': 4940.0} | {'precision': 0.8350923482849604, 'recall': 0.8679159049360147, 'f1-score': 0.8511878081577768, 'support': 2188.0} | {'precision': 0.9312939312939313, 'recall': 0.8982144562207581, 'f1-score': 0.9144551375522505, 'support': 10473.0} | {'precision': 0.8859374039230155, 'recall': 0.9062205170136487, 'f1-score': 0.8959641813320066, 'support': 15899.0} | 0.8622 | {'precision': 0.8260796868154192, 'recall': 0.8285128207571802, 'f1-score': 0.8271034752924407, 'support': 33500.0} | {'precision': 0.8622984418040036, 'recall': 0.8622089552238806, 'f1-score': 0.8620790317320146, 'support': 33500.0} |
114
- | 0.0042 | 42.0 | 3402 | 1.2189 | {'precision': 0.63290648040357, 'recall': 0.6603238866396761, 'f1-score': 0.6463245492371706, 'support': 4940.0} | {'precision': 0.8186907838070628, 'recall': 0.8688299817184644, 'f1-score': 0.8430155210643016, 'support': 2188.0} | {'precision': 0.9273969889064976, 'recall': 0.8940131767401891, 'f1-score': 0.9103991443434294, 'support': 10473.0} | {'precision': 0.8922651933701657, 'recall': 0.8938926976539405, 'f1-score': 0.8930782040405945, 'support': 15899.0} | 0.8579 | {'precision': 0.817814861621824, 'recall': 0.8292649356880676, 'f1-score': 0.8232043546713739, 'support': 33500.0} | {'precision': 0.8601972066380149, 'recall': 0.8578507462686568, 'f1-score': 0.8588364727782227, 'support': 33500.0} |
115
- | 0.0042 | 43.0 | 3483 | 1.2200 | {'precision': 0.6493244605767292, 'recall': 0.6518218623481782, 'f1-score': 0.6505707647237094, 'support': 4940.0} | {'precision': 0.8419167039856695, 'recall': 0.8592321755027422, 'f1-score': 0.8504863153132776, 'support': 2188.0} | {'precision': 0.9239077551814732, 'recall': 0.9066170151818963, 'f1-score': 0.9151807228915662, 'support': 10473.0} | {'precision': 0.8905869877113093, 'recall': 0.8979810050946601, 'f1-score': 0.8942687128092702, 'support': 15899.0} | 0.8619 | {'precision': 0.8264339768637954, 'recall': 0.8289130145318692, 'f1-score': 0.8276266289344558, 'support': 33500.0} | {'precision': 0.8622479110808169, 'recall': 0.8618507462686568, 'f1-score': 0.8620104361623443, 'support': 33500.0} |
116
- | 0.0038 | 44.0 | 3564 | 1.2192 | {'precision': 0.6494427558257345, 'recall': 0.6487854251012146, 'f1-score': 0.649113924050633, 'support': 4940.0} | {'precision': 0.8391670358883474, 'recall': 0.8656307129798904, 'f1-score': 0.8521934758155231, 'support': 2188.0} | {'precision': 0.9273227263798861, 'recall': 0.9015563830803017, 'f1-score': 0.9142580488985719, 'support': 10473.0} | {'precision': 0.886704700483691, 'recall': 0.8993647399207497, 'f1-score': 0.8929898516783762, 'support': 15899.0} | 0.8609 | {'precision': 0.8256593046444147, 'recall': 0.8288343152705391, 'f1-score': 0.827138825110776, 'support': 33500.0} | {'precision': 0.8613108547662561, 'recall': 0.8608955223880597, 'f1-score': 0.8610117106819026, 'support': 33500.0} |
117
- | 0.0038 | 45.0 | 3645 | 1.2218 | {'precision': 0.6585365853658537, 'recall': 0.6340080971659919, 'f1-score': 0.6460396039603961, 'support': 4940.0} | {'precision': 0.8490310950878774, 'recall': 0.8610603290676416, 'f1-score': 0.85500340367597, 'support': 2188.0} | {'precision': 0.923443579766537, 'recall': 0.9064260479327795, 'f1-score': 0.9148556835156363, 'support': 10473.0} | {'precision': 0.8835949522930132, 'recall': 0.902824076985974, 'f1-score': 0.8931060228969636, 'support': 15899.0} | 0.8616 | {'precision': 0.8286515531283204, 'recall': 0.8260796377880968, 'f1-score': 0.8272511785122416, 'support': 33500.0} | {'precision': 0.8606075082137657, 'recall': 0.8615820895522388, 'f1-score': 0.8609838603673272, 'support': 33500.0} |
118
- | 0.0038 | 46.0 | 3726 | 1.2381 | {'precision': 0.6517081059227815, 'recall': 0.6526315789473685, 'f1-score': 0.6521695155254374, 'support': 4940.0} | {'precision': 0.8559011893870082, 'recall': 0.8551188299817185, 'f1-score': 0.8555098308184728, 'support': 2188.0} | {'precision': 0.9215743440233236, 'recall': 0.9054712116871957, 'f1-score': 0.9134518133217743, 'support': 10473.0} | {'precision': 0.8870436026621882, 'recall': 0.8969746524938675, 'f1-score': 0.8919814861145858, 'support': 15899.0} | 0.8609 | {'precision': 0.8290568104988254, 'recall': 0.8275490682775376, 'f1-score': 0.8282781614450676, 'support': 33500.0} | {'precision': 0.8611016175916333, 'recall': 0.8608656716417911, 'f1-score': 0.8609482807516783, 'support': 33500.0} |
119
- | 0.0038 | 47.0 | 3807 | 1.2339 | {'precision': 0.6445289057811562, 'recall': 0.6522267206477733, 'f1-score': 0.6483549652882584, 'support': 4940.0} | {'precision': 0.8536474852741278, 'recall': 0.8610603290676416, 'f1-score': 0.8573378839590444, 'support': 2188.0} | {'precision': 0.9263456090651558, 'recall': 0.9054712116871957, 'f1-score': 0.9157894736842105, 'support': 10473.0} | {'precision': 0.887712524132777, 'recall': 0.8965343732310208, 'f1-score': 0.8921016397546626, 'support': 15899.0} | 0.8610 | {'precision': 0.8280586310633042, 'recall': 0.8288231586584078, 'f1-score': 0.8283959906715441, 'support': 33500.0} | {'precision': 0.861704850067615, 'recall': 0.8609850746268657, 'f1-score': 0.8612930133427016, 'support': 33500.0} |
120
- | 0.0038 | 48.0 | 3888 | 1.2307 | {'precision': 0.6515679442508711, 'recall': 0.6435222672064778, 'f1-score': 0.6475201140645687, 'support': 4940.0} | {'precision': 0.8524886877828054, 'recall': 0.8610603290676416, 'f1-score': 0.8567530695770805, 'support': 2188.0} | {'precision': 0.9257454687195479, 'recall': 0.9070944333046882, 'f1-score': 0.9163250542560887, 'support': 10473.0} | {'precision': 0.8866183664623196, 'recall': 0.9005597836341909, 'f1-score': 0.8935346979530704, 'support': 15899.0} | 0.8621 | {'precision': 0.8291051168038859, 'recall': 0.8280592033032497, 'f1-score': 0.8285332339627021, 'support': 33500.0} | {'precision': 0.8619602565896216, 'recall': 0.8621194029850746, 'f1-score': 0.8619792697221943, 'support': 33500.0} |
121
- | 0.0038 | 49.0 | 3969 | 1.2301 | {'precision': 0.649795918367347, 'recall': 0.6445344129554655, 'f1-score': 0.6471544715447154, 'support': 4940.0} | {'precision': 0.8505643340857788, 'recall': 0.8610603290676416, 'f1-score': 0.8557801498977969, 'support': 2188.0} | {'precision': 0.9270436566070905, 'recall': 0.9063305643082211, 'f1-score': 0.9165701042873696, 'support': 10473.0} | {'precision': 0.8865972996407779, 'recall': 0.9003710925215422, 'f1-score': 0.8934311124980496, 'support': 15899.0} | 0.8619 | {'precision': 0.8285003021752486, 'recall': 0.8280740997132177, 'f1-score': 0.8282339595569829, 'support': 33500.0} | {'precision': 0.8619691129059451, 'recall': 0.8619402985074627, 'f1-score': 0.8618892542452355, 'support': 33500.0} |
122
- | 0.0027 | 50.0 | 4050 | 1.2317 | {'precision': 0.6477872513195291, 'recall': 0.6459514170040486, 'f1-score': 0.6468680316237584, 'support': 4940.0} | {'precision': 0.8505643340857788, 'recall': 0.8610603290676416, 'f1-score': 0.8557801498977969, 'support': 2188.0} | {'precision': 0.926710256660486, 'recall': 0.9067124988064547, 'f1-score': 0.9166023166023166, 'support': 10473.0} | {'precision': 0.8874751737835154, 'recall': 0.8993647399207497, 'f1-score': 0.8933804004873324, 'support': 15899.0} | 0.8618 | {'precision': 0.8281342539623273, 'recall': 0.8282722461997236, 'f1-score': 0.828157724652801, 'support': 33500.0} | {'precision': 0.8619853161339563, 'recall': 0.8617910447761195, 'f1-score': 0.8618330177111018, 'support': 33500.0} |
123
 
124
 
125
  ### Framework versions
 
17
  name: essays_su_g
18
  type: essays_su_g
19
  config: simple
20
+ split: train[80%:100%]
21
  args: simple
22
  metrics:
23
  - name: Accuracy
24
  type: accuracy
25
+ value: 0.8590463087005322
26
  ---
27
 
28
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
32
 
33
  This model is a fine-tuned version of [allenai/longformer-base-4096](https://huggingface.co/allenai/longformer-base-4096) on the essays_su_g dataset.
34
  It achieves the following results on the evaluation set:
35
+ - Loss: 1.1263
36
+ - Claim: {'precision': 0.6273854961832062, 'recall': 0.6309980806142035, 'f1-score': 0.6291866028708135, 'support': 4168.0}
37
+ - Majorclaim: {'precision': 0.8152077807250221, 'recall': 0.8568773234200744, 'f1-score': 0.8355233348436791, 'support': 2152.0}
38
+ - O: {'precision': 0.9466531895777179, 'recall': 0.9136137004118795, 'f1-score': 0.9298400441257586, 'support': 9226.0}
39
+ - Premise: {'precision': 0.8827175597422723, 'recall': 0.8964631823076286, 'f1-score': 0.889537272951426, 'support': 12073.0}
40
+ - Accuracy: 0.8590
41
+ - Macro avg: {'precision': 0.8179910065570546, 'recall': 0.8244880716884464, 'f1-score': 0.8210218136979194, 'support': 27619.0}
42
+ - Weighted avg: {'precision': 0.8602824620016775, 'recall': 0.8590463087005322, 'f1-score': 0.8595019269631762, 'support': 27619.0}
43
 
44
  ## Model description
45
 
 
68
 
69
  ### Training results
70
 
71
+ | Training Loss | Epoch | Step | Validation Loss | Claim | Majorclaim | O | Premise | Accuracy | Macro avg | Weighted avg |
72
+ |:-------------:|:-----:|:----:|:---------------:|:--------------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|:--------:|:-------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|
73
+ | No log | 1.0 | 81 | 0.5105 | {'precision': 0.5640703517587939, 'recall': 0.32317658349328215, 'f1-score': 0.41092129347162903, 'support': 4168.0} | {'precision': 0.5929304446978335, 'recall': 0.724907063197026, 'f1-score': 0.6523102655237298, 'support': 2152.0} | {'precision': 0.8545380875202593, 'recall': 0.9143724257533059, 'f1-score': 0.8834432924913603, 'support': 9226.0} | {'precision': 0.8441231929604023, 'recall': 0.8899196554294707, 'f1-score': 0.8664166767469054, 'support': 12073.0} | 0.7997 | {'precision': 0.7139155192343223, 'recall': 0.7130939319682712, 'f1-score': 0.7032728820584061, 'support': 27619.0} | {'precision': 0.7857670171690952, 'recall': 0.7997031029363844, 'f1-score': 0.7866826459135919, 'support': 27619.0} |
74
+ | No log | 2.0 | 162 | 0.4469 | {'precision': 0.5678977272727272, 'recall': 0.47960652591170827, 'f1-score': 0.5200312174817897, 'support': 4168.0} | {'precision': 0.7948320413436692, 'recall': 0.7146840148698885, 'f1-score': 0.7526302911671151, 'support': 2152.0} | {'precision': 0.944560669456067, 'recall': 0.8808801213960546, 'f1-score': 0.9116096466629278, 'support': 9226.0} | {'precision': 0.8259587020648967, 'recall': 0.9276898865236478, 'f1-score': 0.8738735224125151, 'support': 12073.0} | 0.8278 | {'precision': 0.7833122850343401, 'recall': 0.7507151371753248, 'f1-score': 0.7645361694310869, 'support': 27619.0} | {'precision': 0.8242076985653165, 'recall': 0.8278359100619139, 'f1-score': 0.8236335905447046, 'support': 27619.0} |
75
+ | No log | 3.0 | 243 | 0.4093 | {'precision': 0.5744204961366409, 'recall': 0.6777831094049904, 'f1-score': 0.6218357913273168, 'support': 4168.0} | {'precision': 0.7360824742268042, 'recall': 0.8294609665427509, 'f1-score': 0.7799868909766223, 'support': 2152.0} | {'precision': 0.9330596419204014, 'recall': 0.8868415347929763, 'f1-score': 0.9093637121422617, 'support': 9226.0} | {'precision': 0.89797514556357, 'recall': 0.855876749772219, 'f1-score': 0.876420695504665, 'support': 12073.0} | 0.8373 | {'precision': 0.7853844394618541, 'recall': 0.8124905901282342, 'f1-score': 0.7969017724877165, 'support': 27619.0} | {'precision': 0.8482528803063183, 'recall': 0.8372859263550454, 'f1-score': 0.8414917278933443, 'support': 27619.0} |
76
+ | No log | 4.0 | 324 | 0.5161 | {'precision': 0.516112873601603, 'recall': 0.7416026871401151, 'f1-score': 0.608644284729743, 'support': 4168.0} | {'precision': 0.7790381125226861, 'recall': 0.7978624535315985, 'f1-score': 0.788337924701561, 'support': 2152.0} | {'precision': 0.9442684500762643, 'recall': 0.8723173639713853, 'f1-score': 0.9068679925629612, 'support': 9226.0} | {'precision': 0.8985600293497202, 'recall': 0.8114801623457302, 'f1-score': 0.8528029247910863, 'support': 12073.0} | 0.8202 | {'precision': 0.7844948663875684, 'recall': 0.8058156667472073, 'f1-score': 0.789163281696338, 'support': 27619.0} | {'precision': 0.8468005514342695, 'recall': 0.8201962417176581, 'f1-score': 0.8289940404467937, 'support': 27619.0} |
77
+ | No log | 5.0 | 405 | 0.5154 | {'precision': 0.5811590856615101, 'recall': 0.6038867562380038, 'f1-score': 0.5923049770561243, 'support': 4168.0} | {'precision': 0.8014598540145985, 'recall': 0.7653345724907064, 'f1-score': 0.7829807463750891, 'support': 2152.0} | {'precision': 0.9311288483466362, 'recall': 0.8851073054411446, 'f1-score': 0.9075350077795066, 'support': 9226.0} | {'precision': 0.8633555323758325, 'recall': 0.891244926695933, 'f1-score': 0.8770785784153896, 'support': 12073.0} | 0.8360 | {'precision': 0.7942758300996444, 'recall': 0.7863933902164468, 'f1-score': 0.7899748274065275, 'support': 27619.0} | {'precision': 0.8385857117236715, 'recall': 0.8360186827908324, 'f1-score': 0.8369451960444566, 'support': 27619.0} |
78
+ | No log | 6.0 | 486 | 0.5418 | {'precision': 0.6108374384236454, 'recall': 0.5057581573896354, 'f1-score': 0.5533534584591154, 'support': 4168.0} | {'precision': 0.8107317073170732, 'recall': 0.7723048327137546, 'f1-score': 0.7910518800571156, 'support': 2152.0} | {'precision': 0.919331636605068, 'recall': 0.9004985909386516, 'f1-score': 0.909817664129661, 'support': 9226.0} | {'precision': 0.8410671966975002, 'recall': 0.9112896546011762, 'f1-score': 0.8747714081259442, 'support': 12073.0} | 0.8357 | {'precision': 0.7954919947608217, 'recall': 0.7724628089108043, 'f1-score': 0.782248602692959, 'support': 27619.0} | {'precision': 0.8301032992701898, 'recall': 0.8356566132010572, 'f1-score': 0.8314498656832355, 'support': 27619.0} |
79
+ | 0.345 | 7.0 | 567 | 0.5832 | {'precision': 0.6017184735911044, 'recall': 0.571257197696737, 'f1-score': 0.5860923076923077, 'support': 4168.0} | {'precision': 0.8264023210831721, 'recall': 0.7941449814126395, 'f1-score': 0.8099526066350711, 'support': 2152.0} | {'precision': 0.9157418381639909, 'recall': 0.9212009538261435, 'f1-score': 0.9184632841627491, 'support': 9226.0} | {'precision': 0.8666450093397222, 'recall': 0.8838731052762362, 'f1-score': 0.8751742803247764, 'support': 12073.0} | 0.8422 | {'precision': 0.8026269105444974, 'recall': 0.792619059552939, 'f1-score': 0.7974206197037261, 'support': 27619.0} | {'precision': 0.8399297508801243, 'recall': 0.84217386581701, 'f1-score': 0.8409273360363069, 'support': 27619.0} |
80
+ | 0.345 | 8.0 | 648 | 0.5916 | {'precision': 0.6281560826319816, 'recall': 0.5909309021113244, 'f1-score': 0.6089751514402275, 'support': 4168.0} | {'precision': 0.806993006993007, 'recall': 0.804368029739777, 'f1-score': 0.8056783802653014, 'support': 2152.0} | {'precision': 0.9243136825987094, 'recall': 0.9159982657706481, 'f1-score': 0.9201371876531113, 'support': 9226.0} | {'precision': 0.8721998388396455, 'recall': 0.8965460117617825, 'f1-score': 0.8842053669893396, 'support': 12073.0} | 0.8497 | {'precision': 0.8079156527658359, 'recall': 0.801960802345883, 'f1-score': 0.8047490215869949, 'support': 27619.0} | {'precision': 0.8476986926907486, 'recall': 0.8497411202433107, 'f1-score': 0.8485544514458778, 'support': 27619.0} |
81
+ | 0.345 | 9.0 | 729 | 0.6681 | {'precision': 0.5974557019536574, 'recall': 0.6309980806142035, 'f1-score': 0.6137689614935823, 'support': 4168.0} | {'precision': 0.761437908496732, 'recall': 0.8661710037174721, 'f1-score': 0.8104347826086956, 'support': 2152.0} | {'precision': 0.9265518003092555, 'recall': 0.9092781270323, 'f1-score': 0.9178336980306346, 'support': 9226.0} | {'precision': 0.8886043533930857, 'recall': 0.8622546177420691, 'f1-score': 0.8752312090129477, 'support': 12073.0} | 0.8434 | {'precision': 0.7935124410381827, 'recall': 0.8171754572765112, 'f1-score': 0.804317162786465, 'support': 27619.0} | {'precision': 0.8474346288061019, 'recall': 0.8433686954632681, 'f1-score': 0.8449561811840803, 'support': 27619.0} |
82
+ | 0.345 | 10.0 | 810 | 0.7243 | {'precision': 0.5741487455197133, 'recall': 0.6149232245681382, 'f1-score': 0.5938368860055606, 'support': 4168.0} | {'precision': 0.8037466547725245, 'recall': 0.837360594795539, 'f1-score': 0.8202093764223942, 'support': 2152.0} | {'precision': 0.9286033519553073, 'recall': 0.9008237589421201, 'f1-score': 0.9145026408450704, 'support': 9226.0} | {'precision': 0.8756164841594918, 'recall': 0.8676385322620724, 'f1-score': 0.8716092527874855, 'support': 12073.0} | 0.8382 | {'precision': 0.7955288091017592, 'recall': 0.8051865276419675, 'f1-score': 0.8000395390151277, 'support': 27619.0} | {'precision': 0.8422219164630815, 'recall': 0.8382273072884608, 'f1-score': 0.840013852502701, 'support': 27619.0} |
83
+ | 0.345 | 11.0 | 891 | 0.7493 | {'precision': 0.5898203592814372, 'recall': 0.614443378119002, 'f1-score': 0.6018801410105759, 'support': 4168.0} | {'precision': 0.8243443839683325, 'recall': 0.7741635687732342, 'f1-score': 0.7984663311766117, 'support': 2152.0} | {'precision': 0.9334944195144402, 'recall': 0.8793626707132018, 'f1-score': 0.9056203605514316, 'support': 9226.0} | {'precision': 0.8616792678074016, 'recall': 0.8967945001242442, 'f1-score': 0.878886273236464, 'support': 12073.0} | 0.8388 | {'precision': 0.8023346076429029, 'recall': 0.7911910294324205, 'f1-score': 0.7962132764937708, 'support': 27619.0} | {'precision': 0.8417333606018996, 'recall': 0.838806618632101, 'f1-score': 0.8397473983726959, 'support': 27619.0} |
84
+ | 0.345 | 12.0 | 972 | 0.7472 | {'precision': 0.5856969205834684, 'recall': 0.6936180422264875, 'f1-score': 0.6351054481546573, 'support': 4168.0} | {'precision': 0.7993659420289855, 'recall': 0.8201672862453532, 'f1-score': 0.8096330275229358, 'support': 2152.0} | {'precision': 0.9461520684076727, 'recall': 0.8874918707999133, 'f1-score': 0.9158836689038031, 'support': 9226.0} | {'precision': 0.8926486760849336, 'recall': 0.8740164002319225, 'f1-score': 0.8832342847576798, 'support': 12073.0} | 0.8471 | {'precision': 0.8059659017762651, 'recall': 0.8188233998759191, 'f1-score': 0.810964107334769, 'support': 27619.0} | {'precision': 0.8569306173916821, 'recall': 0.8470980122379521, 'f1-score': 0.8509605717920246, 'support': 27619.0} |
85
+ | 0.0604 | 13.0 | 1053 | 0.8128 | {'precision': 0.5960222412318221, 'recall': 0.6686660268714012, 'f1-score': 0.6302578018995931, 'support': 4168.0} | {'precision': 0.8172757475083057, 'recall': 0.800185873605948, 'f1-score': 0.8086405259450574, 'support': 2152.0} | {'precision': 0.9477475417333638, 'recall': 0.8984391935833514, 'f1-score': 0.9224348987313599, 'support': 9226.0} | {'precision': 0.8838709677419355, 'recall': 0.8851155470885447, 'f1-score': 0.8844928196002152, 'support': 12073.0} | 0.8503 | {'precision': 0.8112291245538568, 'recall': 0.8131016602873112, 'f1-score': 0.8114565115440564, 'support': 27619.0} | {'precision': 0.8565802934093382, 'recall': 0.8502842246279735, 'f1-score': 0.8528902247322565, 'support': 27619.0} |
86
+ | 0.0604 | 14.0 | 1134 | 0.8995 | {'precision': 0.6241429970617042, 'recall': 0.6115642994241842, 'f1-score': 0.6177896267571498, 'support': 4168.0} | {'precision': 0.7095697329376854, 'recall': 0.8889405204460966, 'f1-score': 0.7891914191419142, 'support': 2152.0} | {'precision': 0.9549846806504831, 'recall': 0.8783871667027965, 'f1-score': 0.915085817524842, 'support': 9226.0} | {'precision': 0.8733101270946328, 'recall': 0.8935641514122422, 'f1-score': 0.8833210513387375, 'support': 12073.0} | 0.8456 | {'precision': 0.7905018844361265, 'recall': 0.8181140344963299, 'f1-score': 0.8013469786906608, 'support': 27619.0} | {'precision': 0.850232952139105, 'recall': 0.8455773199608965, 'f1-score': 0.8465260836240982, 'support': 27619.0} |
87
+ | 0.0604 | 15.0 | 1215 | 0.9128 | {'precision': 0.5816304108987036, 'recall': 0.6350767754318618, 'f1-score': 0.6071797224452345, 'support': 4168.0} | {'precision': 0.7725922783198982, 'recall': 0.8461895910780669, 'f1-score': 0.8077178975382568, 'support': 2152.0} | {'precision': 0.9512505789717461, 'recall': 0.8904183828311294, 'f1-score': 0.9198298062926884, 'support': 9226.0} | {'precision': 0.8719668737060041, 'recall': 0.8721113227863828, 'f1-score': 0.8720390922643698, 'support': 12073.0} | 0.8404 | {'precision': 0.794360035474088, 'recall': 0.8109490180318603, 'f1-score': 0.8016916296351374, 'support': 27619.0} | {'precision': 0.8468933720777774, 'recall': 0.8404359317860893, 'f1-score': 0.8430215341764057, 'support': 27619.0} |
88
+ | 0.0604 | 16.0 | 1296 | 0.8803 | {'precision': 0.6304191616766467, 'recall': 0.6314779270633397, 'f1-score': 0.6309481002037637, 'support': 4168.0} | {'precision': 0.8195592286501377, 'recall': 0.8294609665427509, 'f1-score': 0.8244803695150116, 'support': 2152.0} | {'precision': 0.9101446193109315, 'recall': 0.9277043138955127, 'f1-score': 0.9188405797101449, 'support': 9226.0} | {'precision': 0.8933569381217332, 'recall': 0.8777437256688478, 'f1-score': 0.8854815124294965, 'support': 12073.0} | 0.8535 | {'precision': 0.8133699869398623, 'recall': 0.8165967332926127, 'f1-score': 0.8149376404646043, 'support': 27619.0} | {'precision': 0.8535345630772185, 'recall': 0.8535066439769724, 'f1-score': 0.8534601153123827, 'support': 27619.0} |
89
+ | 0.0604 | 17.0 | 1377 | 0.8617 | {'precision': 0.6221813161527842, 'recall': 0.6487523992322457, 'f1-score': 0.6351891003053795, 'support': 4168.0} | {'precision': 0.7972493345164152, 'recall': 0.8350371747211895, 'f1-score': 0.8157058556513844, 'support': 2152.0} | {'precision': 0.9221517603323858, 'recall': 0.914155647084327, 'f1-score': 0.9181362943609842, 'support': 9226.0} | {'precision': 0.8921923692411353, 'recall': 0.8774124078522323, 'f1-score': 0.8847406664996242, 'support': 12073.0} | 0.8519 | {'precision': 0.8084436950606801, 'recall': 0.8188394072224987, 'f1-score': 0.813442979204343, 'support': 27619.0} | {'precision': 0.8540549226358285, 'recall': 0.8518773308229842, 'f1-score': 0.8528573333523664, 'support': 27619.0} |
90
+ | 0.0604 | 18.0 | 1458 | 0.9965 | {'precision': 0.6335570469798658, 'recall': 0.5662188099808061, 'f1-score': 0.5979982262764474, 'support': 4168.0} | {'precision': 0.8203703703703704, 'recall': 0.8234200743494424, 'f1-score': 0.8218923933209649, 'support': 2152.0} | {'precision': 0.9406885581183957, 'recall': 0.8973553002384566, 'f1-score': 0.9185111222055806, 'support': 9226.0} | {'precision': 0.8547127503286167, 'recall': 0.9155967862171789, 'f1-score': 0.8841078141246101, 'support': 12073.0} | 0.8496 | {'precision': 0.8123321814493122, 'recall': 0.800647742696471, 'f1-score': 0.8056273889819007, 'support': 27619.0} | {'precision': 0.8473819646173586, 'recall': 0.8495962924074008, 'f1-score': 0.8475754477331567, 'support': 27619.0} |
91
+ | 0.0201 | 19.0 | 1539 | 0.9760 | {'precision': 0.5662385321100918, 'recall': 0.7404030710172744, 'f1-score': 0.6417134539405281, 'support': 4168.0} | {'precision': 0.8062157221206582, 'recall': 0.8197026022304833, 'f1-score': 0.8129032258064516, 'support': 2152.0} | {'precision': 0.9517297802711547, 'recall': 0.8826143507478864, 'f1-score': 0.9158699808795411, 'support': 9226.0} | {'precision': 0.8939168490153173, 'recall': 0.8459372152737513, 'f1-score': 0.8692654694016513, 'support': 12073.0} | 0.8402 | {'precision': 0.8045252208793054, 'recall': 0.8221643098173489, 'f1-score': 0.809938032507043, 'support': 27619.0} | {'precision': 0.8569454182549012, 'recall': 0.8402186900322242, 'f1-score': 0.8461018818074655, 'support': 27619.0} |
92
+ | 0.0201 | 20.0 | 1620 | 1.0000 | {'precision': 0.6002422774076317, 'recall': 0.7132917466410749, 'f1-score': 0.651902203705734, 'support': 4168.0} | {'precision': 0.8425531914893617, 'recall': 0.8280669144981413, 'f1-score': 0.8352472463088821, 'support': 2152.0} | {'precision': 0.9323666150099623, 'recall': 0.9129633644049425, 'f1-score': 0.9225629791894853, 'support': 9226.0} | {'precision': 0.8987583572110793, 'recall': 0.8573676799469891, 'f1-score': 0.8775752437473505, 'support': 12073.0} | 0.8519 | {'precision': 0.8184801102795087, 'recall': 0.8279224263727869, 'f1-score': 0.821821918237863, 'support': 27619.0} | {'precision': 0.8605564400235849, 'recall': 0.8519135377819617, 'f1-score': 0.8552486484979966, 'support': 27619.0} |
93
+ | 0.0201 | 21.0 | 1701 | 1.0823 | {'precision': 0.5819801980198019, 'recall': 0.7051343570057581, 'f1-score': 0.6376654371881102, 'support': 4168.0} | {'precision': 0.7559021922428331, 'recall': 0.83317843866171, 'f1-score': 0.792661361626879, 'support': 2152.0} | {'precision': 0.9542405366554864, 'recall': 0.8634294385432474, 'f1-score': 0.9065665187208377, 'support': 9226.0} | {'precision': 0.8881762174023125, 'recall': 0.8716971755156133, 'f1-score': 0.8798595435164284, 'support': 12073.0} | 0.8408 | {'precision': 0.7950747860801084, 'recall': 0.8183598524315823, 'f1-score': 0.8041882152630638, 'support': 27619.0} | {'precision': 0.8537300281304444, 'recall': 0.8407980013758645, 'f1-score': 0.8454369732073347, 'support': 27619.0} |
94
+ | 0.0201 | 22.0 | 1782 | 0.9630 | {'precision': 0.6159964648696421, 'recall': 0.6689059500959693, 'f1-score': 0.6413618587531631, 'support': 4168.0} | {'precision': 0.8129032258064516, 'recall': 0.8197026022304833, 'f1-score': 0.8162887552059233, 'support': 2152.0} | {'precision': 0.9430451554345359, 'recall': 0.9009321482766096, 'f1-score': 0.9215077605321508, 'support': 9226.0} | {'precision': 0.8838054339747295, 'recall': 0.886440818355007, 'f1-score': 0.8851211645025227, 'support': 12073.0} | 0.8533 | {'precision': 0.8139375700213398, 'recall': 0.8189953797395173, 'f1-score': 0.8160698847484399, 'support': 27619.0} | {'precision': 0.8576544630844016, 'recall': 0.8532531952641298, 'f1-score': 0.8551268346498754, 'support': 27619.0} |
95
+ | 0.0201 | 23.0 | 1863 | 1.0519 | {'precision': 0.6434384537131231, 'recall': 0.6070057581573897, 'f1-score': 0.6246913580246913, 'support': 4168.0} | {'precision': 0.8249312557286893, 'recall': 0.8364312267657993, 'f1-score': 0.8306414397784957, 'support': 2152.0} | {'precision': 0.9472960586617782, 'recall': 0.8961630175590722, 'f1-score': 0.9210203854294309, 'support': 9226.0} | {'precision': 0.8635830007043908, 'recall': 0.9139401971341009, 'f1-score': 0.8880482897384305, 'support': 12073.0} | 0.8556 | {'precision': 0.8198121922019954, 'recall': 0.8133850499040906, 'f1-score': 0.8161003682427621, 'support': 27619.0} | {'precision': 0.8553131736167897, 'recall': 0.8556428545566458, 'f1-score': 0.8548461217507599, 'support': 27619.0} |
96
+ | 0.0201 | 24.0 | 1944 | 1.0346 | {'precision': 0.605771270952684, 'recall': 0.6849808061420346, 'f1-score': 0.6429456142326315, 'support': 4168.0} | {'precision': 0.8141632837167343, 'recall': 0.8387546468401487, 'f1-score': 0.8262760357061112, 'support': 2152.0} | {'precision': 0.9483018430508867, 'recall': 0.8867331454584869, 'f1-score': 0.9164846244328684, 'support': 9226.0} | {'precision': 0.8831039628585641, 'recall': 0.8822993456473122, 'f1-score': 0.8827014708928941, 'support': 12073.0} | 0.8506 | {'precision': 0.8128350901447173, 'recall': 0.8231919860219956, 'f1-score': 0.8171019363161263, 'support': 27619.0} | {'precision': 0.8576588939305595, 'recall': 0.8506100872587712, 'f1-score': 0.8534083548306859, 'support': 27619.0} |
97
+ | 0.0091 | 25.0 | 2025 | 1.0354 | {'precision': 0.637881679389313, 'recall': 0.6415547024952015, 'f1-score': 0.6397129186602871, 'support': 4168.0} | {'precision': 0.798523664785063, 'recall': 0.8545539033457249, 'f1-score': 0.8255892255892255, 'support': 2152.0} | {'precision': 0.9484063288236643, 'recall': 0.8965965748970302, 'f1-score': 0.9217740138176956, 'support': 9226.0} | {'precision': 0.8766328011611031, 'recall': 0.9005218255611696, 'f1-score': 0.8884167517875383, 'support': 12073.0} | 0.8565 | {'precision': 0.8153611185397858, 'recall': 0.8233067515747815, 'f1-score': 0.8188732274636866, 'support': 27619.0} | {'precision': 0.8584922830101466, 'recall': 0.8565480285310837, 'f1-score': 0.8571321899510156, 'support': 27619.0} |
98
+ | 0.0091 | 26.0 | 2106 | 1.0637 | {'precision': 0.6577010910936311, 'recall': 0.6218809980806143, 'f1-score': 0.639289678135405, 'support': 4168.0} | {'precision': 0.8118231046931408, 'recall': 0.8359665427509294, 'f1-score': 0.8237179487179487, 'support': 2152.0} | {'precision': 0.9386496186630776, 'recall': 0.9071103403425103, 'f1-score': 0.9226105170323007, 'support': 9226.0} | {'precision': 0.8770125936553483, 'recall': 0.9113724840553301, 'f1-score': 0.8938624639506073, 'support': 12073.0} | 0.8604 | {'precision': 0.8212966020262995, 'recall': 0.8190825913073461, 'f1-score': 0.8198701519590654, 'support': 27619.0} | {'precision': 0.8594263331027361, 'recall': 0.8603859661827004, 'f1-score': 0.8595824092662689, 'support': 27619.0} |
99
+ | 0.0091 | 27.0 | 2187 | 1.0722 | {'precision': 0.6361293345829429, 'recall': 0.6513915547024952, 'f1-score': 0.643669985775249, 'support': 4168.0} | {'precision': 0.8111062527328378, 'recall': 0.8619888475836431, 'f1-score': 0.835773822933093, 'support': 2152.0} | {'precision': 0.9478951000690131, 'recall': 0.893236505527856, 'f1-score': 0.9197544642857143, 'support': 9226.0} | {'precision': 0.8817299919159256, 'recall': 0.9034208564565559, 'f1-score': 0.892443644397169, 'support': 12073.0} | 0.8588 | {'precision': 0.8192151698251797, 'recall': 0.8275094410676376, 'f1-score': 0.8229104793478063, 'support': 27619.0} | {'precision': 0.8612655819566406, 'recall': 0.8587566530287121, 'f1-score': 0.8596085511412532, 'support': 27619.0} |
100
+ | 0.0091 | 28.0 | 2268 | 1.0253 | {'precision': 0.654979674796748, 'recall': 0.6185220729366603, 'f1-score': 0.6362290227048372, 'support': 4168.0} | {'precision': 0.8579910935180604, 'recall': 0.8057620817843866, 'f1-score': 0.831056793673616, 'support': 2152.0} | {'precision': 0.9374237212914679, 'recall': 0.9157814871016692, 'f1-score': 0.9264762322495751, 'support': 9226.0} | {'precision': 0.8726381532136928, 'recall': 0.9142715149507165, 'f1-score': 0.8929698244478602, 'support': 12073.0} | 0.8617 | {'precision': 0.8307581607049922, 'recall': 0.8135842891933581, 'f1-score': 0.8216829682689721, 'support': 27619.0} | {'precision': 0.8602912413261778, 'recall': 0.8616894167058908, 'f1-score': 0.8605934753580137, 'support': 27619.0} |
101
+ | 0.0091 | 29.0 | 2349 | 1.0103 | {'precision': 0.6270194333879654, 'recall': 0.6425143953934741, 'f1-score': 0.6346723545443773, 'support': 4168.0} | {'precision': 0.8632949424136205, 'recall': 0.8011152416356877, 'f1-score': 0.8310436249698723, 'support': 2152.0} | {'precision': 0.9391839016210173, 'recall': 0.9105787990461739, 'f1-score': 0.9246601728028178, 'support': 9226.0} | {'precision': 0.8799774302756731, 'recall': 0.9042491509980949, 'f1-score': 0.8919482004983863, 'support': 12073.0} | 0.8588 | {'precision': 0.8273689269245691, 'recall': 0.8146143967683577, 'f1-score': 0.8205810882038633, 'support': 27619.0} | {'precision': 0.8602811798583894, 'recall': 0.8588290669466672, 'f1-score': 0.8593043062229604, 'support': 27619.0} |
102
+ | 0.0091 | 30.0 | 2430 | 1.0344 | {'precision': 0.6081264108352145, 'recall': 0.6463531669865643, 'f1-score': 0.6266573621772505, 'support': 4168.0} | {'precision': 0.7980556783031374, 'recall': 0.8392193308550185, 'f1-score': 0.8181200453001133, 'support': 2152.0} | {'precision': 0.9434216434665469, 'recall': 0.9109039670496423, 'f1-score': 0.9268776883202824, 'support': 9226.0} | {'precision': 0.8859211183225162, 'recall': 0.8818851983765427, 'f1-score': 0.8838985513262215, 'support': 12073.0} | 0.8527 | {'precision': 0.8088812127318536, 'recall': 0.819590415816942, 'f1-score': 0.8138884117809669, 'support': 27619.0} | {'precision': 0.8563604925666979, 'recall': 0.852710090879467, 'f1-score': 0.8543098224282204, 'support': 27619.0} |
103
+ | 0.0054 | 31.0 | 2511 | 1.0803 | {'precision': 0.6008753647353063, 'recall': 0.6916986564299424, 'f1-score': 0.6430961409770243, 'support': 4168.0} | {'precision': 0.8070973612374887, 'recall': 0.8243494423791822, 'f1-score': 0.8156321839080459, 'support': 2152.0} | {'precision': 0.948917649753751, 'recall': 0.8980056362453934, 'f1-score': 0.922759926491062, 'support': 9226.0} | {'precision': 0.8907669021190716, 'recall': 0.8774124078522323, 'f1-score': 0.884039223868141, 'support': 12073.0} | 0.8521 | {'precision': 0.8119143194614044, 'recall': 0.8228665357266876, 'f1-score': 0.8163818688110683, 'support': 27619.0} | {'precision': 0.8599248737286467, 'recall': 0.8521307795358268, 'f1-score': 0.85528273315214, 'support': 27619.0} |
104
+ | 0.0054 | 32.0 | 2592 | 1.0980 | {'precision': 0.6518208016767094, 'recall': 0.5969289827255279, 'f1-score': 0.6231684408265498, 'support': 4168.0} | {'precision': 0.823960880195599, 'recall': 0.7829925650557621, 'f1-score': 0.802954491303312, 'support': 2152.0} | {'precision': 0.9439581675571217, 'recall': 0.9000650336006937, 'f1-score': 0.9214892082339233, 'support': 9226.0} | {'precision': 0.8618055555555556, 'recall': 0.925122173444877, 'f1-score': 0.8923421084168898, 'support': 12073.0} | 0.8561 | {'precision': 0.8203863512462465, 'recall': 0.8012771887067152, 'f1-score': 0.8099885621951687, 'support': 27619.0} | {'precision': 0.8546105739408988, 'recall': 0.856149751982331, 'f1-score': 0.8544925535585312, 'support': 27619.0} |
105
+ | 0.0054 | 33.0 | 2673 | 1.1032 | {'precision': 0.6132238547968885, 'recall': 0.6809021113243762, 'f1-score': 0.645293315143247, 'support': 4168.0} | {'precision': 0.8150716597318539, 'recall': 0.8192379182156134, 'f1-score': 0.8171494785631519, 'support': 2152.0} | {'precision': 0.9452505100884153, 'recall': 0.9038586603078257, 'f1-score': 0.9240913120567376, 'support': 9226.0} | {'precision': 0.8901382642012328, 'recall': 0.8851983765426986, 'f1-score': 0.8876614477345405, 'support': 12073.0} | 0.8555 | {'precision': 0.8159210722045976, 'recall': 0.8222992665976285, 'f1-score': 0.8185488883744192, 'support': 27619.0} | {'precision': 0.8609099427319448, 'recall': 0.8554618197617582, 'f1-score': 0.8577606473413056, 'support': 27619.0} |
106
+ | 0.0054 | 34.0 | 2754 | 1.1183 | {'precision': 0.6371614844533601, 'recall': 0.6096449136276392, 'f1-score': 0.6230995586071605, 'support': 4168.0} | {'precision': 0.812132186509733, 'recall': 0.8336431226765799, 'f1-score': 0.8227470763586332, 'support': 2152.0} | {'precision': 0.9402985074626866, 'recall': 0.9081942336874052, 'f1-score': 0.9239675800849093, 'support': 9226.0} | {'precision': 0.875469586763648, 'recall': 0.9072310113476352, 'f1-score': 0.8910673608851285, 'support': 12073.0} | 0.8569 | {'precision': 0.8162654412973569, 'recall': 0.8146783203348149, 'f1-score': 0.8152203939839578, 'support': 27619.0} | {'precision': 0.856227085825657, 'recall': 0.8569100981208588, 'f1-score': 0.8562950074379215, 'support': 27619.0} |
107
+ | 0.0054 | 35.0 | 2835 | 1.1262 | {'precision': 0.6121336059986366, 'recall': 0.6463531669865643, 'f1-score': 0.6287781538102462, 'support': 4168.0} | {'precision': 0.8249312557286893, 'recall': 0.8364312267657993, 'f1-score': 0.8306414397784957, 'support': 2152.0} | {'precision': 0.9574964969640355, 'recall': 0.8887925428137872, 'f1-score': 0.9218662169758292, 'support': 9226.0} | {'precision': 0.8728351507376524, 'recall': 0.9016814379193241, 'f1-score': 0.8870238337746996, 'support': 12073.0} | 0.8538 | {'precision': 0.8168491273572535, 'recall': 0.8183145936213687, 'f1-score': 0.8170774110848177, 'support': 27619.0} | {'precision': 0.8580407106693336, 'recall': 0.853760092689815, 'f1-score': 0.8552975917471803, 'support': 27619.0} |
108
+ | 0.0054 | 36.0 | 2916 | 1.1356 | {'precision': 0.6130514705882353, 'recall': 0.6401151631477927, 'f1-score': 0.6262910798122067, 'support': 4168.0} | {'precision': 0.7958567112645663, 'recall': 0.8568773234200744, 'f1-score': 0.8252405459834415, 'support': 2152.0} | {'precision': 0.9530980572479595, 'recall': 0.8986559722523304, 'f1-score': 0.9250767085076709, 'support': 9226.0} | {'precision': 0.87943841319076, 'recall': 0.8924045390540877, 'f1-score': 0.8858740338760073, 'support': 12073.0} | 0.8537 | {'precision': 0.8103611630728802, 'recall': 0.8220132494685712, 'f1-score': 0.8156205920448316, 'support': 27619.0} | {'precision': 0.8573309971640839, 'recall': 0.8536514718128825, 'f1-score': 0.8550712842351443, 'support': 27619.0} |
109
+ | 0.0054 | 37.0 | 2997 | 1.1102 | {'precision': 0.6272071623974136, 'recall': 0.6050863723608445, 'f1-score': 0.6159482232262792, 'support': 4168.0} | {'precision': 0.8087902129587675, 'recall': 0.8294609665427509, 'f1-score': 0.81899518238128, 'support': 2152.0} | {'precision': 0.9405296229802513, 'recall': 0.9085194016908736, 'f1-score': 0.9242474363215348, 'support': 9226.0} | {'precision': 0.8751502524240724, 'recall': 0.9045804688147105, 'f1-score': 0.889622026718801, 'support': 12073.0} | 0.8548 | {'precision': 0.8129193126901262, 'recall': 0.8119118023522949, 'f1-score': 0.8122032171619737, 'support': 27619.0} | {'precision': 0.8544020887900109, 'recall': 0.8548463014591404, 'f1-score': 0.8543851480129697, 'support': 27619.0} |
110
+ | 0.0039 | 38.0 | 3078 | 1.0967 | {'precision': 0.6231203007518797, 'recall': 0.6362763915547025, 'f1-score': 0.6296296296296297, 'support': 4168.0} | {'precision': 0.8036028119507909, 'recall': 0.849907063197026, 'f1-score': 0.8261065943992774, 'support': 2152.0} | {'precision': 0.9439659993289341, 'recall': 0.9148059830912638, 'f1-score': 0.9291572631694831, 'support': 9226.0} | {'precision': 0.885394368516384, 'recall': 0.8907479499710097, 'f1-score': 0.8880630909616417, 'support': 12073.0} | 0.8572 | {'precision': 0.8140208701369972, 'recall': 0.8229343469535004, 'f1-score': 0.8182391445400079, 'support': 27619.0} | {'precision': 0.8590070308758098, 'recall': 0.857199753792679, 'f1-score': 0.8579625726718959, 'support': 27619.0} |
111
+ | 0.0039 | 39.0 | 3159 | 1.1243 | {'precision': 0.6262814538676608, 'recall': 0.6449136276391555, 'f1-score': 0.6354609929078013, 'support': 4168.0} | {'precision': 0.7901023890784983, 'recall': 0.8605947955390335, 'f1-score': 0.8238434163701068, 'support': 2152.0} | {'precision': 0.9577708549671167, 'recall': 0.8997398655972252, 'f1-score': 0.9278488794500642, 'support': 9226.0} | {'precision': 0.8812926274764534, 'recall': 0.8990308953863994, 'f1-score': 0.8900733937430809, 'support': 12073.0} | 0.8579 | {'precision': 0.8138618313474322, 'recall': 0.8260697960404534, 'f1-score': 0.8193066706177633, 'support': 27619.0} | {'precision': 0.8612506332766275, 'recall': 0.8579238929722293, 'f1-score': 0.8591079436234004, 'support': 27619.0} |
112
+ | 0.0039 | 40.0 | 3240 | 1.1121 | {'precision': 0.6214638527166592, 'recall': 0.6641074856046065, 'f1-score': 0.6420784040825794, 'support': 4168.0} | {'precision': 0.8057118130679359, 'recall': 0.8652416356877324, 'f1-score': 0.8344163118978265, 'support': 2152.0} | {'precision': 0.9444382211269183, 'recall': 0.9138304790808585, 'f1-score': 0.9288822784112818, 'support': 9226.0} | {'precision': 0.8936027500628826, 'recall': 0.8827963223722356, 'f1-score': 0.8881666666666668, 'support': 12073.0} | 0.8588 | {'precision': 0.816304159243599, 'recall': 0.8314939806863582, 'f1-score': 0.8233859152645886, 'support': 27619.0} | {'precision': 0.8626672287002196, 'recall': 0.8587928599876896, 'f1-score': 0.8604421144396781, 'support': 27619.0} |
113
+ | 0.0039 | 41.0 | 3321 | 1.1615 | {'precision': 0.5966553852279515, 'recall': 0.7190499040307101, 'f1-score': 0.6521597214666522, 'support': 4168.0} | {'precision': 0.8222222222222222, 'recall': 0.8252788104089219, 'f1-score': 0.823747680890538, 'support': 2152.0} | {'precision': 0.9584831265220921, 'recall': 0.8958378495556037, 'f1-score': 0.9261023026500084, 'support': 9226.0} | {'precision': 0.8921527131126725, 'recall': 0.8729396173279218, 'f1-score': 0.8824415975885456, 'support': 12073.0} | 0.8537 | {'precision': 0.8173783617712345, 'recall': 0.8282765453307894, 'f1-score': 0.821112825648936, 'support': 27619.0} | {'precision': 0.8642676019607676, 'recall': 0.8536514718128825, 'f1-score': 0.857701002218941, 'support': 27619.0} |
114
+ | 0.0039 | 42.0 | 3402 | 1.1097 | {'precision': 0.6225523295070898, 'recall': 0.6636276391554703, 'f1-score': 0.6424340959238184, 'support': 4168.0} | {'precision': 0.8328716528162512, 'recall': 0.8382899628252788, 'f1-score': 0.8355720240852247, 'support': 2152.0} | {'precision': 0.9516516173276945, 'recall': 0.9024495989594624, 'f1-score': 0.9263977746870653, 'support': 9226.0} | {'precision': 0.8826360003262377, 'recall': 0.8963803528534747, 'f1-score': 0.889455083422372, 'support': 12073.0} | 0.8588 | {'precision': 0.8224278999943182, 'recall': 0.8251868884484215, 'f1-score': 0.8234647445296202, 'support': 27619.0} | {'precision': 0.8625634584760528, 'recall': 0.8587566530287121, 'f1-score': 0.860319106378328, 'support': 27619.0} |
115
+ | 0.0039 | 43.0 | 3483 | 1.1389 | {'precision': 0.6155963302752293, 'recall': 0.6439539347408829, 'f1-score': 0.6294559099437148, 'support': 4168.0} | {'precision': 0.8046532045654082, 'recall': 0.8517657992565055, 'f1-score': 0.8275395033860045, 'support': 2152.0} | {'precision': 0.9582417582417583, 'recall': 0.897897246910904, 'f1-score': 0.9270885792624923, 'support': 9226.0} | {'precision': 0.8781614785992218, 'recall': 0.8972914768491675, 'f1-score': 0.8876234175918718, 'support': 12073.0} | 0.8557 | {'precision': 0.8141631929204045, 'recall': 0.8227271144393651, 'f1-score': 0.8179268525460208, 'support': 27619.0} | {'precision': 0.8595604907302502, 'recall': 0.8557152684746008, 'f1-score': 0.8571647777542455, 'support': 27619.0} |
116
+ | 0.0026 | 44.0 | 3564 | 1.1342 | {'precision': 0.6240409207161125, 'recall': 0.6439539347408829, 'f1-score': 0.6338410674223639, 'support': 4168.0} | {'precision': 0.799826313504125, 'recall': 0.8559479553903345, 'f1-score': 0.8269360269360269, 'support': 2152.0} | {'precision': 0.9584583429494576, 'recall': 0.9002818122696726, 'f1-score': 0.9284596467695059, 'support': 9226.0} | {'precision': 0.8793424568790995, 'recall': 0.8994450426571688, 'f1-score': 0.8892801572352798, 'support': 12073.0} | 0.8578 | {'precision': 0.8154170085121986, 'recall': 0.8249071862645148, 'f1-score': 0.819629224590794, 'support': 27619.0} | {'precision': 0.861047356463257, 'recall': 0.8577790651363192, 'f1-score': 0.8589617270132784, 'support': 27619.0} |
117
+ | 0.0026 | 45.0 | 3645 | 1.1367 | {'precision': 0.6169934640522876, 'recall': 0.6794625719769674, 'f1-score': 0.6467229961178351, 'support': 4168.0} | {'precision': 0.812694185530404, 'recall': 0.8508364312267658, 'f1-score': 0.831328036322361, 'support': 2152.0} | {'precision': 0.9527514014414826, 'recall': 0.9026663776284414, 'f1-score': 0.927032893638337, 'support': 9226.0} | {'precision': 0.8909846281678437, 'recall': 0.8881802368922389, 'f1-score': 0.8895802223328355, 'support': 12073.0} | 0.8586 | {'precision': 0.8183559197980044, 'recall': 0.8302864044311034, 'f1-score': 0.8236660371028421, 'support': 27619.0} | {'precision': 0.864169176689991, 'recall': 0.8586118251928021, 'f1-score': 0.8609025266271941, 'support': 27619.0} |
118
+ | 0.0026 | 46.0 | 3726 | 1.1422 | {'precision': 0.6169026169026169, 'recall': 0.6900191938579654, 'f1-score': 0.6514156285390714, 'support': 4168.0} | {'precision': 0.8026828212894851, 'recall': 0.8619888475836431, 'f1-score': 0.8312794084696392, 'support': 2152.0} | {'precision': 0.9538074548364966, 'recall': 0.9041838283112942, 'f1-score': 0.9283329623859337, 'support': 9226.0} | {'precision': 0.8952941176470588, 'recall': 0.8824650045556199, 'f1-score': 0.8888332707629416, 'support': 12073.0} | 0.8591 | {'precision': 0.8171717526689144, 'recall': 0.8346642185771307, 'f1-score': 0.8249653175393965, 'support': 27619.0} | {'precision': 0.8656119699967246, 'recall': 0.8590825156595098, 'f1-score': 0.8617146752478776, 'support': 27619.0} |
119
+ | 0.0026 | 47.0 | 3807 | 1.1345 | {'precision': 0.6162966156499246, 'recall': 0.6859404990403071, 'f1-score': 0.6492562734188714, 'support': 4168.0} | {'precision': 0.8003449762828806, 'recall': 0.862453531598513, 'f1-score': 0.8302393200626258, 'support': 2152.0} | {'precision': 0.9542955326460482, 'recall': 0.9029915456319099, 'f1-score': 0.927934952105146, 'support': 9226.0} | {'precision': 0.8938060514625765, 'recall': 0.8832932990971589, 'f1-score': 0.8885185802366272, 'support': 12073.0} | 0.8585 | {'precision': 0.8161857940103575, 'recall': 0.8336697188419722, 'f1-score': 0.8239872814558176, 'support': 27619.0} | {'precision': 0.8648509260469159, 'recall': 0.858466997356892, 'f1-score': 0.8610372515914226, 'support': 27619.0} |
120
+ | 0.0026 | 48.0 | 3888 | 1.1346 | {'precision': 0.6188230008984726, 'recall': 0.6609884836852208, 'f1-score': 0.6392111368909513, 'support': 4168.0} | {'precision': 0.8088363954505686, 'recall': 0.8592007434944238, 'f1-score': 0.8332582244254167, 'support': 2152.0} | {'precision': 0.9490855723639647, 'recall': 0.9112291350531108, 'f1-score': 0.9297721742977217, 'support': 9226.0} | {'precision': 0.8901272560924894, 'recall': 0.886440818355007, 'f1-score': 0.8882802124833998, 'support': 12073.0} | 0.8586 | {'precision': 0.8167180562013739, 'recall': 0.8294647951469407, 'f1-score': 0.8226304370243724, 'support': 27619.0} | {'precision': 0.8625453508160694, 'recall': 0.8585756182338246, 'f1-score': 0.8602660778054183, 'support': 27619.0} |
121
+ | 0.0026 | 49.0 | 3969 | 1.1303 | {'precision': 0.6245327102803738, 'recall': 0.6413147792706334, 'f1-score': 0.6328125, 'support': 4168.0} | {'precision': 0.810989010989011, 'recall': 0.8573420074349443, 'f1-score': 0.8335215721707703, 'support': 2152.0} | {'precision': 0.9477242000901307, 'recall': 0.9117710817255582, 'f1-score': 0.9294000662910176, 'support': 9226.0} | {'precision': 0.8852149655398753, 'recall': 0.893646980866396, 'f1-score': 0.8894109888298091, 'support': 12073.0} | 0.8588 | {'precision': 0.8171152217248476, 'recall': 0.826018712324383, 'f1-score': 0.8212862818228992, 'support': 27619.0} | {'precision': 0.8609726795717226, 'recall': 0.8587928599876896, 'f1-score': 0.8596909664743367, 'support': 27619.0} |
122
+ | 0.0024 | 50.0 | 4050 | 1.1263 | {'precision': 0.6273854961832062, 'recall': 0.6309980806142035, 'f1-score': 0.6291866028708135, 'support': 4168.0} | {'precision': 0.8152077807250221, 'recall': 0.8568773234200744, 'f1-score': 0.8355233348436791, 'support': 2152.0} | {'precision': 0.9466531895777179, 'recall': 0.9136137004118795, 'f1-score': 0.9298400441257586, 'support': 9226.0} | {'precision': 0.8827175597422723, 'recall': 0.8964631823076286, 'f1-score': 0.889537272951426, 'support': 12073.0} | 0.8590 | {'precision': 0.8179910065570546, 'recall': 0.8244880716884464, 'f1-score': 0.8210218136979194, 'support': 27619.0} | {'precision': 0.8602824620016775, 'recall': 0.8590463087005322, 'f1-score': 0.8595019269631762, 'support': 27619.0} |
123
 
124
 
125
  ### Framework versions
meta_data/README_s42_e50.md CHANGED
@@ -17,12 +17,12 @@ model-index:
17
  name: essays_su_g
18
  type: essays_su_g
19
  config: simple
20
- split: train[60%:80%]
21
  args: simple
22
  metrics:
23
  - name: Accuracy
24
  type: accuracy
25
- value: 0.8617910447761195
26
  ---
27
 
28
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -32,14 +32,14 @@ should probably proofread and complete it, then remove this comment. -->
32
 
33
  This model is a fine-tuned version of [allenai/longformer-base-4096](https://huggingface.co/allenai/longformer-base-4096) on the essays_su_g dataset.
34
  It achieves the following results on the evaluation set:
35
- - Loss: 1.2317
36
- - Claim: {'precision': 0.6477872513195291, 'recall': 0.6459514170040486, 'f1-score': 0.6468680316237584, 'support': 4940.0}
37
- - Majorclaim: {'precision': 0.8505643340857788, 'recall': 0.8610603290676416, 'f1-score': 0.8557801498977969, 'support': 2188.0}
38
- - O: {'precision': 0.926710256660486, 'recall': 0.9067124988064547, 'f1-score': 0.9166023166023166, 'support': 10473.0}
39
- - Premise: {'precision': 0.8874751737835154, 'recall': 0.8993647399207497, 'f1-score': 0.8933804004873324, 'support': 15899.0}
40
- - Accuracy: 0.8618
41
- - Macro avg: {'precision': 0.8281342539623273, 'recall': 0.8282722461997236, 'f1-score': 0.828157724652801, 'support': 33500.0}
42
- - Weighted avg: {'precision': 0.8619853161339563, 'recall': 0.8617910447761195, 'f1-score': 0.8618330177111018, 'support': 33500.0}
43
 
44
  ## Model description
45
 
@@ -68,58 +68,58 @@ The following hyperparameters were used during training:
68
 
69
  ### Training results
70
 
71
- | Training Loss | Epoch | Step | Validation Loss | Claim | Majorclaim | O | Premise | Accuracy | Macro avg | Weighted avg |
72
- |:-------------:|:-----:|:----:|:---------------:|:-------------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|:--------:|:-------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|
73
- | No log | 1.0 | 81 | 0.4981 | {'precision': 0.6228840125391849, 'recall': 0.40222672064777326, 'f1-score': 0.4888068880688806, 'support': 4940.0} | {'precision': 0.7604525332021643, 'recall': 0.706581352833638, 'f1-score': 0.7325278370054489, 'support': 2188.0} | {'precision': 0.827613377692173, 'recall': 0.902606702950444, 'f1-score': 0.8634848138844484, 'support': 10473.0} | {'precision': 0.8543458914268763, 'recall': 0.9057173407132524, 'f1-score': 0.8792819197655248, 'support': 15899.0} | 0.8175 | {'precision': 0.7663239537150996, 'recall': 0.7292830292862769, 'f1-score': 0.7410253646810757, 'support': 33500.0} | {'precision': 0.80572410140167, 'recall': 0.8174925373134329, 'f1-score': 0.8071778099281224, 'support': 33500.0} |
74
- | No log | 2.0 | 162 | 0.4563 | {'precision': 0.6593780369290574, 'recall': 0.5493927125506073, 'f1-score': 0.5993816254416962, 'support': 4940.0} | {'precision': 0.7197382769901853, 'recall': 0.9049360146252285, 'f1-score': 0.8017817371937639, 'support': 2188.0} | {'precision': 0.9337184554575859, 'recall': 0.8796906330564308, 'f1-score': 0.9058997050147494, 'support': 10473.0} | {'precision': 0.862579028987236, 'recall': 0.9096169570413234, 'f1-score': 0.8854737486606459, 'support': 15899.0} | 0.8468 | {'precision': 0.7938534495910161, 'recall': 0.8109090793183975, 'f1-score': 0.7981342040777137, 'support': 33500.0} | {'precision': 0.8455251408465503, 'recall': 0.8468358208955223, 'f1-score': 0.8442053257085675, 'support': 33500.0} |
75
- | No log | 3.0 | 243 | 0.4382 | {'precision': 0.6285479226655697, 'recall': 0.6186234817813765, 'f1-score': 0.6235462150581514, 'support': 4940.0} | {'precision': 0.8059701492537313, 'recall': 0.8638025594149908, 'f1-score': 0.8338848444738584, 'support': 2188.0} | {'precision': 0.8974646833193002, 'recall': 0.9159744103886184, 'f1-score': 0.9066250826953974, 'support': 10473.0} | {'precision': 0.8911176621379133, 'recall': 0.8745833071262343, 'f1-score': 0.8827730692315017, 'support': 15899.0} | 0.8491 | {'precision': 0.8057751043441286, 'recall': 0.818245939677805, 'f1-score': 0.8117073028647273, 'support': 33500.0} | {'precision': 0.8488213959184715, 'recall': 0.8490746268656716, 'f1-score': 0.8488105033097496, 'support': 33500.0} |
76
- | No log | 4.0 | 324 | 0.4750 | {'precision': 0.6477507222451506, 'recall': 0.6354251012145749, 'f1-score': 0.6415287144900879, 'support': 4940.0} | {'precision': 0.7514033680834001, 'recall': 0.856489945155393, 'f1-score': 0.8005126014523707, 'support': 2188.0} | {'precision': 0.9273871354374751, 'recall': 0.8865654540246348, 'f1-score': 0.9065169636319258, 'support': 10473.0} | {'precision': 0.8863636363636364, 'recall': 0.9002452984464432, 'f1-score': 0.8932505382719131, 'support': 15899.0} | 0.8541 | {'precision': 0.8032262155324155, 'recall': 0.8196814497102615, 'f1-score': 0.8104522044615743, 'support': 33500.0} | {'precision': 0.8551874645146165, 'recall': 0.8540597014925373, 'f1-score': 0.8542213698406307, 'support': 33500.0} |
77
- | No log | 5.0 | 405 | 0.5162 | {'precision': 0.6808882235528942, 'recall': 0.5524291497975709, 'f1-score': 0.6099687080911935, 'support': 4940.0} | {'precision': 0.8330275229357799, 'recall': 0.829981718464351, 'f1-score': 0.8315018315018317, 'support': 2188.0} | {'precision': 0.9074091642159188, 'recall': 0.9133008689009835, 'f1-score': 0.9103454839630722, 'support': 10473.0} | {'precision': 0.8682249120505635, 'recall': 0.915843763758727, 'f1-score': 0.8913988368533824, 'support': 15899.0} | 0.8559 | {'precision': 0.8223874556887891, 'recall': 0.8028888752304081, 'f1-score': 0.8108037151023699, 'support': 33500.0} | {'precision': 0.8505509283002989, 'recall': 0.8558507462686568, 'f1-score': 0.8519095458499607, 'support': 33500.0} |
78
- | No log | 6.0 | 486 | 0.5529 | {'precision': 0.6227477477477478, 'recall': 0.6716599190283401, 'f1-score': 0.646279703934554, 'support': 4940.0} | {'precision': 0.8152593227603944, 'recall': 0.8692870201096892, 'f1-score': 0.8414067684140676, 'support': 2188.0} | {'precision': 0.9295788637266588, 'recall': 0.8936312422419556, 'f1-score': 0.9112506693929215, 'support': 10473.0} | {'precision': 0.8897343224906474, 'recall': 0.8825712308950249, 'f1-score': 0.8861383012314494, 'support': 15899.0} | 0.8541 | {'precision': 0.8143300641813621, 'recall': 0.8292873530687525, 'f1-score': 0.8212688607432481, 'support': 33500.0} | {'precision': 0.8579560210496036, 'recall': 0.8540597014925373, 'f1-score': 0.8556973390614198, 'support': 33500.0} |
79
- | 0.3328 | 7.0 | 567 | 0.5894 | {'precision': 0.6739491807171694, 'recall': 0.5744939271255061, 'f1-score': 0.6202600808654791, 'support': 4940.0} | {'precision': 0.8730305838739574, 'recall': 0.8610603290676416, 'f1-score': 0.8670041417395307, 'support': 2188.0} | {'precision': 0.9097314797181489, 'recall': 0.9122505490308412, 'f1-score': 0.9109892729439809, 'support': 10473.0} | {'precision': 0.8677611401767996, 'recall': 0.9076042518397384, 'f1-score': 0.8872356123954747, 'support': 15899.0} | 0.8569 | {'precision': 0.8311180961215189, 'recall': 0.8138522642659318, 'f1-score': 0.8213722769861164, 'support': 33500.0} | {'precision': 0.8526463291050193, 'recall': 0.8568955223880597, 'f1-score': 0.8539713289140156, 'support': 33500.0} |
80
- | 0.3328 | 8.0 | 648 | 0.5878 | {'precision': 0.5974385600553825, 'recall': 0.6987854251012146, 'f1-score': 0.6441500279902966, 'support': 4940.0} | {'precision': 0.7849375755134917, 'recall': 0.8907678244972578, 'f1-score': 0.834510811389424, 'support': 2188.0} | {'precision': 0.9398542543364466, 'recall': 0.874343550081161, 'f1-score': 0.9059161060546101, 'support': 10473.0} | {'precision': 0.8915849251419721, 'recall': 0.8689854707843261, 'f1-score': 0.8801401497053671, 'support': 15899.0} | 0.8470 | {'precision': 0.8034538287618231, 'recall': 0.8332205676159898, 'f1-score': 0.8161792737849245, 'support': 33500.0} | {'precision': 0.8563340964894008, 'recall': 0.8469850746268657, 'f1-score': 0.8504184600736624, 'support': 33500.0} |
81
- | 0.3328 | 9.0 | 729 | 0.7043 | {'precision': 0.6375797489195307, 'recall': 0.6271255060728745, 'f1-score': 0.6323094193285029, 'support': 4940.0} | {'precision': 0.8373732921992068, 'recall': 0.8683729433272395, 'f1-score': 0.8525914292124747, 'support': 2188.0} | {'precision': 0.9134194927606647, 'recall': 0.8975460708488494, 'f1-score': 0.9054132151801194, 'support': 10473.0} | {'precision': 0.883775884584292, 'recall': 0.8938926976539405, 'f1-score': 0.8888055034396498, 'support': 15899.0} | 0.8540 | {'precision': 0.8180371046159236, 'recall': 0.821734304475726, 'f1-score': 0.8197798917901866, 'support': 33500.0} | {'precision': 0.8537078167069386, 'recall': 0.8540298507462687, 'f1-score': 0.853808653145316, 'support': 33500.0} |
82
- | 0.3328 | 10.0 | 810 | 0.7164 | {'precision': 0.6368453230079478, 'recall': 0.6325910931174089, 'f1-score': 0.6347110795166041, 'support': 4940.0} | {'precision': 0.8921119592875318, 'recall': 0.8011882998171846, 'f1-score': 0.8442090055381651, 'support': 2188.0} | {'precision': 0.9040270982310877, 'recall': 0.9174066647569942, 'f1-score': 0.9106677408653618, 'support': 10473.0} | {'precision': 0.881375, 'recall': 0.8869740235234921, 'f1-score': 0.8841656478259506, 'support': 15899.0} | 0.8534 | {'precision': 0.8285898451316418, 'recall': 0.8095400203037699, 'f1-score': 0.8184383684365204, 'support': 33500.0} | {'precision': 0.8530989190255094, 'recall': 0.8533731343283583, 'f1-score': 0.8530559678148433, 'support': 33500.0} |
83
- | 0.3328 | 11.0 | 891 | 0.7852 | {'precision': 0.6161486113665624, 'recall': 0.6781376518218624, 'f1-score': 0.645658668208538, 'support': 4940.0} | {'precision': 0.7885714285714286, 'recall': 0.8829981718464351, 'f1-score': 0.8331177231565331, 'support': 2188.0} | {'precision': 0.9366843393148451, 'recall': 0.8772080588179128, 'f1-score': 0.9059711059612445, 'support': 10473.0} | {'precision': 0.8929452704840241, 'recall': 0.8876658909365369, 'f1-score': 0.8902977542265961, 'support': 15899.0} | 0.8532 | {'precision': 0.8085874124342151, 'recall': 0.8315024433556868, 'f1-score': 0.818761312888228, 'support': 33500.0} | {'precision': 0.8589850855801485, 'recall': 0.8531940298507462, 'f1-score': 0.8553879040715653, 'support': 33500.0} |
84
- | 0.3328 | 12.0 | 972 | 0.8325 | {'precision': 0.6280645804265498, 'recall': 0.6378542510121458, 'f1-score': 0.6329215627196947, 'support': 4940.0} | {'precision': 0.8278829604130808, 'recall': 0.8793418647166362, 'f1-score': 0.8528368794326241, 'support': 2188.0} | {'precision': 0.9193064031773709, 'recall': 0.9061395970591044, 'f1-score': 0.9126755145220234, 'support': 10473.0} | {'precision': 0.8894291487749432, 'recall': 0.88590477388515, 'f1-score': 0.8876634630534112, 'support': 15899.0} | 0.8552 | {'precision': 0.8161707731979861, 'recall': 0.827310121668259, 'f1-score': 0.8215243549319383, 'support': 33500.0} | {'precision': 0.8562082669116539, 'recall': 0.8552238805970149, 'f1-score': 0.8556433335734092, 'support': 33500.0} |
85
- | 0.0589 | 13.0 | 1053 | 0.8543 | {'precision': 0.6377388535031847, 'recall': 0.648582995951417, 'f1-score': 0.6431152147731835, 'support': 4940.0} | {'precision': 0.8206835330670218, 'recall': 0.8450639853747715, 'f1-score': 0.8326953388876379, 'support': 2188.0} | {'precision': 0.9408790755262072, 'recall': 0.8707151723479424, 'f1-score': 0.904438383337466, 'support': 10473.0} | {'precision': 0.8749621922448733, 'recall': 0.9097427511164224, 'f1-score': 0.892013567684243, 'support': 15899.0} | 0.8548 | {'precision': 0.8185659135853218, 'recall': 0.8185262261976383, 'f1-score': 0.8180656261706326, 'support': 33500.0} | {'precision': 0.8570428644520474, 'recall': 0.8548059701492537, 'f1-score': 0.8553204019036041, 'support': 33500.0} |
86
- | 0.0589 | 14.0 | 1134 | 0.9095 | {'precision': 0.6138420585625555, 'recall': 0.7002024291497976, 'f1-score': 0.6541843971631205, 'support': 4940.0} | {'precision': 0.7806142800159553, 'recall': 0.8944241316270567, 'f1-score': 0.8336528221512247, 'support': 2188.0} | {'precision': 0.9421004003695719, 'recall': 0.8762532225723288, 'f1-score': 0.9079845651528643, 'support': 10473.0} | {'precision': 0.8974194787731319, 'recall': 0.8815019812566828, 'f1-score': 0.889389516436096, 'support': 15899.0} | 0.8540 | {'precision': 0.8084940544303038, 'recall': 0.8380954411514664, 'f1-score': 0.8213028252258264, 'support': 33500.0} | {'precision': 0.8619418985092084, 'recall': 0.8539701492537314, 'f1-score': 0.8568784946124219, 'support': 33500.0} |
87
- | 0.0589 | 15.0 | 1215 | 0.9577 | {'precision': 0.6332046332046332, 'recall': 0.6307692307692307, 'f1-score': 0.631984585741811, 'support': 4940.0} | {'precision': 0.7778225806451613, 'recall': 0.8816270566727605, 'f1-score': 0.8264781491002571, 'support': 2188.0} | {'precision': 0.8886910896655111, 'recall': 0.9056621789363124, 'f1-score': 0.8970963775654971, 'support': 10473.0} | {'precision': 0.8974458706080644, 'recall': 0.8707465878357129, 'f1-score': 0.8838946528332003, 'support': 15899.0} | 0.8470 | {'precision': 0.7992910435308425, 'recall': 0.8222012635535042, 'f1-score': 0.8098634413101913, 'support': 33500.0} | {'precision': 0.8479301603984184, 'recall': 0.8469850746268657, 'f1-score': 0.8471244624308779, 'support': 33500.0} |
88
- | 0.0589 | 16.0 | 1296 | 0.9395 | {'precision': 0.6682400539447066, 'recall': 0.6018218623481781, 'f1-score': 0.6332942805410586, 'support': 4940.0} | {'precision': 0.8464692482915718, 'recall': 0.8491773308957953, 'f1-score': 0.8478211270819075, 'support': 2188.0} | {'precision': 0.9145563502803016, 'recall': 0.9034660555714695, 'f1-score': 0.9089773764349872, 'support': 10473.0} | {'precision': 0.8759539672925499, 'recall': 0.9096169570413234, 'f1-score': 0.8924681415656145, 'support': 15899.0} | 0.8584 | {'precision': 0.8263049049522826, 'recall': 0.8160205514641916, 'f1-score': 0.8206402314058919, 'support': 33500.0} | {'precision': 0.8554663093796615, 'recall': 0.8583582089552239, 'f1-score': 0.8564948483009961, 'support': 33500.0} |
89
- | 0.0589 | 17.0 | 1377 | 0.9581 | {'precision': 0.6657279029462738, 'recall': 0.6220647773279352, 'f1-score': 0.6431561322729175, 'support': 4940.0} | {'precision': 0.8350423539901917, 'recall': 0.8560329067641682, 'f1-score': 0.8454073572556984, 'support': 2188.0} | {'precision': 0.9241991128634796, 'recall': 0.8952544638594481, 'f1-score': 0.909496556407023, 'support': 10473.0} | {'precision': 0.8791828322017459, 'recall': 0.9121957355808541, 'f1-score': 0.8953850902917116, 'support': 15899.0} | 0.8604 | {'precision': 0.8260380505004228, 'recall': 0.8213869708831014, 'f1-score': 0.8233612840568376, 'support': 33500.0} | {'precision': 0.8588965274411914, 'recall': 0.8604477611940299, 'f1-score': 0.859338136623951, 'support': 33500.0} |
90
- | 0.0589 | 18.0 | 1458 | 0.9848 | {'precision': 0.632508155824218, 'recall': 0.6672064777327935, 'f1-score': 0.6493941483597675, 'support': 4940.0} | {'precision': 0.8635122838944495, 'recall': 0.8674588665447898, 'f1-score': 0.8654810761513908, 'support': 2188.0} | {'precision': 0.9323503038756601, 'recall': 0.8935357586173971, 'f1-score': 0.9125304729400293, 'support': 10473.0} | {'precision': 0.8885635978572318, 'recall': 0.8972262406440656, 'f1-score': 0.8928739085531874, 'support': 15899.0} | 0.8602 | {'precision': 0.8292335853628898, 'recall': 0.8313568358847614, 'f1-score': 0.8300699015010937, 'support': 33500.0} | {'precision': 0.8628576878135704, 'recall': 0.8602089552238806, 'f1-score': 0.8613257791852104, 'support': 33500.0} |
91
- | 0.0216 | 19.0 | 1539 | 1.0161 | {'precision': 0.6432509699816213, 'recall': 0.6376518218623481, 'f1-score': 0.6404391582799633, 'support': 4940.0} | {'precision': 0.8103975535168195, 'recall': 0.8478062157221207, 'f1-score': 0.8286799195890104, 'support': 2188.0} | {'precision': 0.9029750479846449, 'recall': 0.898405423469875, 'f1-score': 0.9006844397645144, 'support': 10473.0} | {'precision': 0.8907763936076507, 'recall': 0.8904962576262658, 'f1-score': 0.8906363035888403, 'support': 15899.0} | 0.8529 | {'precision': 0.8118499912726841, 'recall': 0.8185899296701524, 'f1-score': 0.8151099553055821, 'support': 33500.0} | {'precision': 0.8528394387556787, 'recall': 0.8528955223880597, 'f1-score': 0.8528362935634777, 'support': 33500.0} |
92
- | 0.0216 | 20.0 | 1620 | 0.9873 | {'precision': 0.6603498542274052, 'recall': 0.6419028340080971, 'f1-score': 0.650995688770273, 'support': 4940.0} | {'precision': 0.8447589562140646, 'recall': 0.8729433272394881, 'f1-score': 0.8586199145875477, 'support': 2188.0} | {'precision': 0.913972286374134, 'recall': 0.9069034660555715, 'f1-score': 0.9104241552839684, 'support': 10473.0} | {'precision': 0.8866313493300093, 'recall': 0.894773256179634, 'f1-score': 0.8906836964688204, 'support': 15899.0} | 0.8599 | {'precision': 0.8264281115364033, 'recall': 0.8291307208706977, 'f1-score': 0.8276808637776524, 'support': 33500.0} | {'precision': 0.8590759538589217, 'recall': 0.8598507462686568, 'f1-score': 0.8594158610175964, 'support': 33500.0} |
93
- | 0.0216 | 21.0 | 1701 | 1.0280 | {'precision': 0.6169108103096607, 'recall': 0.6734817813765183, 'f1-score': 0.6439562566534404, 'support': 4940.0} | {'precision': 0.8370044052863436, 'recall': 0.8683729433272395, 'f1-score': 0.8524001794526693, 'support': 2188.0} | {'precision': 0.9311383256374222, 'recall': 0.8857061014036093, 'f1-score': 0.9078541717641301, 'support': 10473.0} | {'precision': 0.8857952755905512, 'recall': 0.8844581420215107, 'f1-score': 0.8851262038144394, 'support': 15899.0} | 0.8527 | {'precision': 0.8177122042059943, 'recall': 0.8280047420322194, 'f1-score': 0.8223342029211698, 'support': 33500.0} | {'precision': 0.8571336063495862, 'recall': 0.8526865671641791, 'f1-score': 0.8545305598758789, 'support': 33500.0} |
94
- | 0.0216 | 22.0 | 1782 | 1.0620 | {'precision': 0.6779808529155787, 'recall': 0.6307692307692307, 'f1-score': 0.6535234899328859, 'support': 4940.0} | {'precision': 0.8341377797279509, 'recall': 0.8688299817184644, 'f1-score': 0.8511305126483099, 'support': 2188.0} | {'precision': 0.9212073696589572, 'recall': 0.8975460708488494, 'f1-score': 0.9092228079508632, 'support': 10473.0} | {'precision': 0.882589367273613, 'recall': 0.9115667652053588, 'f1-score': 0.8968440594059406, 'support': 15899.0} | 0.8630 | {'precision': 0.828978842394025, 'recall': 0.8271780121354758, 'f1-score': 0.8276802174844999, 'support': 33500.0} | {'precision': 0.8613257315871389, 'recall': 0.8629850746268657, 'f1-score': 0.8618475752270865, 'support': 33500.0} |
95
- | 0.0216 | 23.0 | 1863 | 1.1896 | {'precision': 0.5858518764530056, 'recall': 0.71417004048583, 'f1-score': 0.6436781609195402, 'support': 4940.0} | {'precision': 0.8349056603773585, 'recall': 0.8898537477148081, 'f1-score': 0.8615044247787611, 'support': 2188.0} | {'precision': 0.9129765113592607, 'recall': 0.905566695311754, 'f1-score': 0.9092565073582283, 'support': 10473.0} | {'precision': 0.9069657135113159, 'recall': 0.841876847600478, 'f1-score': 0.873210033597547, 'support': 15899.0} | 0.8461 | {'precision': 0.8101749404252352, 'recall': 0.8378668327782175, 'f1-score': 0.8219122816635192, 'support': 33500.0} | {'precision': 0.8567860518556853, 'recall': 0.846089552238806, 'f1-score': 0.8498672096145845, 'support': 33500.0} |
96
- | 0.0216 | 24.0 | 1944 | 1.1086 | {'precision': 0.6551451708473237, 'recall': 0.6714574898785425, 'f1-score': 0.6632010396880935, 'support': 4940.0} | {'precision': 0.8465414567109483, 'recall': 0.8446069469835467, 'f1-score': 0.84557309540151, 'support': 2188.0} | {'precision': 0.922805987672439, 'recall': 0.9006015468347178, 'f1-score': 0.911568570600174, 'support': 10473.0} | {'precision': 0.8933449759870268, 'recall': 0.9008742688219384, 'f1-score': 0.8970938243768007, 'support': 15899.0} | 0.8633 | {'precision': 0.8294593978044343, 'recall': 0.8293850631296864, 'f1-score': 0.8293591325166445, 'support': 33500.0} | {'precision': 0.864372798011359, 'recall': 0.8632835820895522, 'f1-score': 0.8637635648495541, 'support': 33500.0} |
97
- | 0.0102 | 25.0 | 2025 | 1.0723 | {'precision': 0.6391891891891892, 'recall': 0.6702429149797571, 'f1-score': 0.6543478260869565, 'support': 4940.0} | {'precision': 0.8314757021845742, 'recall': 0.8523765996343693, 'f1-score': 0.8417964342134958, 'support': 2188.0} | {'precision': 0.9285072391412881, 'recall': 0.8879022247684523, 'f1-score': 0.9077508785630614, 'support': 10473.0} | {'precision': 0.884198729921554, 'recall': 0.8932637272784452, 'f1-score': 0.8887081130127343, 'support': 15899.0} | 0.8560 | {'precision': 0.8208427151091513, 'recall': 0.8259463666652559, 'f1-score': 0.8231508129690621, 'support': 33500.0} | {'precision': 0.8584774732395206, 'recall': 0.8560298507462687, 'f1-score': 0.8570380328032566, 'support': 33500.0} |
98
- | 0.0102 | 26.0 | 2106 | 1.1268 | {'precision': 0.636963696369637, 'recall': 0.66417004048583, 'f1-score': 0.6502824298880191, 'support': 4940.0} | {'precision': 0.8252173913043478, 'recall': 0.8674588665447898, 'f1-score': 0.8458110516934045, 'support': 2188.0} | {'precision': 0.9229943392543432, 'recall': 0.9029886374486775, 'f1-score': 0.912881895844394, 'support': 10473.0} | {'precision': 0.8905271151047269, 'recall': 0.8851500094345557, 'f1-score': 0.8878304207936407, 'support': 15899.0} | 0.8570 | {'precision': 0.8189256355082637, 'recall': 0.8299418884784633, 'f1-score': 0.8242014495548646, 'support': 33500.0} | {'precision': 0.8590204964268868, 'recall': 0.8569850746268657, 'f1-score': 0.8578882907501019, 'support': 33500.0} |
99
- | 0.0102 | 27.0 | 2187 | 1.1018 | {'precision': 0.6353259818146644, 'recall': 0.6647773279352227, 'f1-score': 0.6497180730042537, 'support': 4940.0} | {'precision': 0.8737251092763477, 'recall': 0.8222120658135283, 'f1-score': 0.8471862491170237, 'support': 2188.0} | {'precision': 0.9107074569789675, 'recall': 0.9095770075432064, 'f1-score': 0.9101418812401472, 'support': 10473.0} | {'precision': 0.8921072603086264, 'recall': 0.8872256116736902, 'f1-score': 0.889659739522563, 'support': 15899.0} | 0.8572 | {'precision': 0.8279664520946515, 'recall': 0.8209480032414119, 'f1-score': 0.824176485720997, 'support': 33500.0} | {'precision': 0.8588559229208557, 'recall': 0.8571641791044776, 'f1-score': 0.8579064750628762, 'support': 33500.0} |
100
- | 0.0102 | 28.0 | 2268 | 1.0291 | {'precision': 0.6845411711913844, 'recall': 0.6176113360323887, 'f1-score': 0.6493561775034585, 'support': 4940.0} | {'precision': 0.8403058929374719, 'recall': 0.8537477148080439, 'f1-score': 0.846973475402403, 'support': 2188.0} | {'precision': 0.9202835226721041, 'recall': 0.9049937935644037, 'f1-score': 0.9125746196803388, 'support': 10473.0} | {'precision': 0.8788814236426367, 'recall': 0.9132649852191962, 'f1-score': 0.8957433682911783, 'support': 15899.0} | 0.8632 | {'precision': 0.8310030026108993, 'recall': 0.8224044574060082, 'f1-score': 0.8261619102193447, 'support': 33500.0} | {'precision': 0.8606473960260256, 'recall': 0.8631940298507462, 'f1-score': 0.8614870234454082, 'support': 33500.0} |
101
- | 0.0102 | 29.0 | 2349 | 1.1137 | {'precision': 0.6787787572565039, 'recall': 0.6390688259109312, 'f1-score': 0.6583255135022417, 'support': 4940.0} | {'precision': 0.8508211678832117, 'recall': 0.8523765996343693, 'f1-score': 0.8515981735159819, 'support': 2188.0} | {'precision': 0.916385704652731, 'recall': 0.9083357204239473, 'f1-score': 0.9123429557878584, 'support': 10473.0} | {'precision': 0.8844310641435242, 'recall': 0.9054028555255047, 'f1-score': 0.8947940947940948, 'support': 15899.0} | 0.8636 | {'precision': 0.8326041734839926, 'recall': 0.8262960003736881, 'f1-score': 0.8292651844000442, 'support': 33500.0} | {'precision': 0.8618997238752699, 'recall': 0.8635820895522388, 'f1-score': 0.8625887740134804, 'support': 33500.0} |
102
- | 0.0102 | 30.0 | 2430 | 1.1232 | {'precision': 0.677736508630107, 'recall': 0.6279352226720648, 'f1-score': 0.6518860985604706, 'support': 4940.0} | {'precision': 0.8508412914961346, 'recall': 0.8551188299817185, 'f1-score': 0.8529746979712788, 'support': 2188.0} | {'precision': 0.919930035953746, 'recall': 0.9039434736942614, 'f1-score': 0.911866692352148, 'support': 10473.0} | {'precision': 0.8810929227773383, 'recall': 0.9106862066796654, 'f1-score': 0.8956451812445873, 'support': 15899.0} | 0.8633 | {'precision': 0.8324001897143315, 'recall': 0.8244209332569276, 'f1-score': 0.8280931675321211, 'support': 33500.0} | {'precision': 0.8612711266927389, 'recall': 0.8632537313432835, 'f1-score': 0.8619841364675112, 'support': 33500.0} |
103
- | 0.0075 | 31.0 | 2511 | 1.1208 | {'precision': 0.6758557316793017, 'recall': 0.5955465587044534, 'f1-score': 0.6331647476595287, 'support': 4940.0} | {'precision': 0.8557603686635945, 'recall': 0.8487202925045704, 'f1-score': 0.8522257916475449, 'support': 2188.0} | {'precision': 0.928901109692625, 'recall': 0.9031796046977943, 'f1-score': 0.9158597986057321, 'support': 10473.0} | {'precision': 0.8695962843872812, 'recall': 0.9185483363733569, 'f1-score': 0.8934022573639618, 'support': 15899.0} | 0.8616 | {'precision': 0.8325283736057006, 'recall': 0.8164986980700437, 'f1-score': 0.8236631488191918, 'support': 33500.0} | {'precision': 0.858663392490028, 'recall': 0.8615522388059701, 'f1-score': 0.8593583894385183, 'support': 33500.0} |
104
- | 0.0075 | 32.0 | 2592 | 1.1111 | {'precision': 0.6402947450067868, 'recall': 0.6684210526315789, 'f1-score': 0.6540556600970584, 'support': 4940.0} | {'precision': 0.8271230502599654, 'recall': 0.8724862888482633, 'f1-score': 0.8491992882562277, 'support': 2188.0} | {'precision': 0.934014685453463, 'recall': 0.8987873579681085, 'f1-score': 0.9160624787114983, 'support': 10473.0} | {'precision': 0.8899542520523908, 'recall': 0.8932008302408957, 'f1-score': 0.8915745856353591, 'support': 15899.0} | 0.8604 | {'precision': 0.8228466831931516, 'recall': 0.8332238824222116, 'f1-score': 0.8277230031750359, 'support': 33500.0} | {'precision': 0.8628095441324599, 'recall': 0.8604477611940299, 'f1-score': 0.8614373038849609, 'support': 33500.0} |
105
- | 0.0075 | 33.0 | 2673 | 1.1452 | {'precision': 0.6549778315195486, 'recall': 0.6578947368421053, 'f1-score': 0.6564330438295295, 'support': 4940.0} | {'precision': 0.8285214348206474, 'recall': 0.8656307129798904, 'f1-score': 0.8466696468484577, 'support': 2188.0} | {'precision': 0.9282555282555283, 'recall': 0.9018428339539769, 'f1-score': 0.9148585819449826, 'support': 10473.0} | {'precision': 0.8899048329912297, 'recall': 0.899867916221146, 'f1-score': 0.8948586439829872, 'support': 15899.0} | 0.8626 | {'precision': 0.8254149068967386, 'recall': 0.8313090499992797, 'f1-score': 0.8282049791514892, 'support': 33500.0} | {'precision': 0.8632421634102047, 'recall': 0.8625671641791045, 'f1-score': 0.862804893528884, 'support': 33500.0} |
106
- | 0.0075 | 34.0 | 2754 | 1.1328 | {'precision': 0.6835973904939422, 'recall': 0.5939271255060729, 'f1-score': 0.6356152512998267, 'support': 4940.0} | {'precision': 0.8433895297249334, 'recall': 0.8688299817184644, 'f1-score': 0.8559207564160288, 'support': 2188.0} | {'precision': 0.9166907444861794, 'recall': 0.9088131385467393, 'f1-score': 0.9127349443805141, 'support': 10473.0} | {'precision': 0.876591635990586, 'recall': 0.9136423674444933, 'f1-score': 0.8947336002463814, 'support': 15899.0} | 0.8621 | {'precision': 0.8300673251739102, 'recall': 0.8213031533039424, 'f1-score': 0.8247511380856878, 'support': 33500.0} | {'precision': 0.858499701125263, 'recall': 0.8620597014925373, 'f1-score': 0.8596160160977241, 'support': 33500.0} |
107
- | 0.0075 | 35.0 | 2835 | 1.1654 | {'precision': 0.6584344914190038, 'recall': 0.6368421052631579, 'f1-score': 0.6474583247581807, 'support': 4940.0} | {'precision': 0.8545966228893058, 'recall': 0.8327239488117002, 'f1-score': 0.8435185185185186, 'support': 2188.0} | {'precision': 0.9174373795761079, 'recall': 0.9092905566695312, 'f1-score': 0.9133458015633241, 'support': 10473.0} | {'precision': 0.8844540407156076, 'recall': 0.9017548273476319, 'f1-score': 0.8930206484163319, 'support': 15899.0} | 0.8605 | {'precision': 0.8287306336500063, 'recall': 0.8201528595230052, 'f1-score': 0.8243358233140887, 'support': 33500.0} | {'precision': 0.8594859781531254, 'recall': 0.8605373134328358, 'f1-score': 0.8599304033363548, 'support': 33500.0} |
108
- | 0.0075 | 36.0 | 2916 | 1.1980 | {'precision': 0.654320987654321, 'recall': 0.6115384615384616, 'f1-score': 0.63220675944334, 'support': 4940.0} | {'precision': 0.8379814077025233, 'recall': 0.8651736745886655, 'f1-score': 0.8513604677310547, 'support': 2188.0} | {'precision': 0.9262343260188087, 'recall': 0.9027976701995608, 'f1-score': 0.9143658430443401, 'support': 10473.0} | {'precision': 0.8778021442495126, 'recall': 0.9063463110887477, 'f1-score': 0.8918458920006188, 'support': 15899.0} | 0.8591 | {'precision': 0.8240847164062914, 'recall': 0.8214640293538589, 'f1-score': 0.8224447405548384, 'support': 33500.0} | {'precision': 0.8573873846830882, 'recall': 0.8590746268656716, 'f1-score': 0.857954907646772, 'support': 33500.0} |
109
- | 0.0075 | 37.0 | 2997 | 1.1902 | {'precision': 0.6605045672031318, 'recall': 0.6147773279352227, 'f1-score': 0.6368211365066052, 'support': 4940.0} | {'precision': 0.8536474852741278, 'recall': 0.8610603290676416, 'f1-score': 0.8573378839590444, 'support': 2188.0} | {'precision': 0.9250779423226813, 'recall': 0.9066170151818963, 'f1-score': 0.9157544485701886, 'support': 10473.0} | {'precision': 0.8778528391455176, 'recall': 0.9072268696144412, 'f1-score': 0.8922981750695949, 'support': 15899.0} | 0.8609 | {'precision': 0.8292707084863646, 'recall': 0.8224203854498005, 'f1-score': 0.8255529110263582, 'support': 33500.0} | {'precision': 0.8589849802771131, 'recall': 0.8608955223880597, 'f1-score': 0.859674529246331, 'support': 33500.0} |
110
- | 0.0042 | 38.0 | 3078 | 1.1981 | {'precision': 0.6303837118245889, 'recall': 0.6518218623481782, 'f1-score': 0.6409235668789809, 'support': 4940.0} | {'precision': 0.8486633439057544, 'recall': 0.8560329067641682, 'f1-score': 0.8523321956769055, 'support': 2188.0} | {'precision': 0.9275547266123491, 'recall': 0.9022247684522104, 'f1-score': 0.9147144240077445, 'support': 10473.0} | {'precision': 0.8876734591823978, 'recall': 0.8932008302408957, 'f1-score': 0.8904285669498698, 'support': 15899.0} | 0.858 | {'precision': 0.8235688103812725, 'recall': 0.8258200919513632, 'f1-score': 0.8245996883783752, 'support': 33500.0} | {'precision': 0.8596528929024279, 'recall': 0.858, 'f1-score': 0.8587400959132037, 'support': 33500.0} |
111
- | 0.0042 | 39.0 | 3159 | 1.2141 | {'precision': 0.6662414965986394, 'recall': 0.6344129554655871, 'f1-score': 0.6499377851513894, 'support': 4940.0} | {'precision': 0.8540315106580166, 'recall': 0.8423217550274223, 'f1-score': 0.8481362172112287, 'support': 2188.0} | {'precision': 0.9111302023673158, 'recall': 0.9113911964098157, 'f1-score': 0.9112606807007495, 'support': 10473.0} | {'precision': 0.8855958420987502, 'recall': 0.9002452984464432, 'f1-score': 0.8928604847010387, 'support': 15899.0} | 0.8607 | {'precision': 0.8292497629306805, 'recall': 0.822092801337317, 'f1-score': 0.8255487919411015, 'support': 33500.0} | {'precision': 0.8591704131772522, 'recall': 0.8607462686567164, 'f1-score': 0.8598697509596058, 'support': 33500.0} |
112
- | 0.0042 | 40.0 | 3240 | 1.2188 | {'precision': 0.6613790186125211, 'recall': 0.632995951417004, 'f1-score': 0.6468762929251138, 'support': 4940.0} | {'precision': 0.8279290964115866, 'recall': 0.8752285191956124, 'f1-score': 0.8509220173294822, 'support': 2188.0} | {'precision': 0.921379980563654, 'recall': 0.9052802444380789, 'f1-score': 0.9132591629340654, 'support': 10473.0} | {'precision': 0.8843465891520812, 'recall': 0.8993647399207497, 'f1-score': 0.8917924410627417, 'support': 15899.0} | 0.8604 | {'precision': 0.8237586711849608, 'recall': 0.8282173637428613, 'f1-score': 0.8257124785628508, 'support': 33500.0} | {'precision': 0.8593600051422834, 'recall': 0.8603582089552239, 'f1-score': 0.8597181341740886, 'support': 33500.0} |
113
- | 0.0042 | 41.0 | 3321 | 1.1967 | {'precision': 0.6519950637597697, 'recall': 0.6417004048582996, 'f1-score': 0.646806774127729, 'support': 4940.0} | {'precision': 0.8350923482849604, 'recall': 0.8679159049360147, 'f1-score': 0.8511878081577768, 'support': 2188.0} | {'precision': 0.9312939312939313, 'recall': 0.8982144562207581, 'f1-score': 0.9144551375522505, 'support': 10473.0} | {'precision': 0.8859374039230155, 'recall': 0.9062205170136487, 'f1-score': 0.8959641813320066, 'support': 15899.0} | 0.8622 | {'precision': 0.8260796868154192, 'recall': 0.8285128207571802, 'f1-score': 0.8271034752924407, 'support': 33500.0} | {'precision': 0.8622984418040036, 'recall': 0.8622089552238806, 'f1-score': 0.8620790317320146, 'support': 33500.0} |
114
- | 0.0042 | 42.0 | 3402 | 1.2189 | {'precision': 0.63290648040357, 'recall': 0.6603238866396761, 'f1-score': 0.6463245492371706, 'support': 4940.0} | {'precision': 0.8186907838070628, 'recall': 0.8688299817184644, 'f1-score': 0.8430155210643016, 'support': 2188.0} | {'precision': 0.9273969889064976, 'recall': 0.8940131767401891, 'f1-score': 0.9103991443434294, 'support': 10473.0} | {'precision': 0.8922651933701657, 'recall': 0.8938926976539405, 'f1-score': 0.8930782040405945, 'support': 15899.0} | 0.8579 | {'precision': 0.817814861621824, 'recall': 0.8292649356880676, 'f1-score': 0.8232043546713739, 'support': 33500.0} | {'precision': 0.8601972066380149, 'recall': 0.8578507462686568, 'f1-score': 0.8588364727782227, 'support': 33500.0} |
115
- | 0.0042 | 43.0 | 3483 | 1.2200 | {'precision': 0.6493244605767292, 'recall': 0.6518218623481782, 'f1-score': 0.6505707647237094, 'support': 4940.0} | {'precision': 0.8419167039856695, 'recall': 0.8592321755027422, 'f1-score': 0.8504863153132776, 'support': 2188.0} | {'precision': 0.9239077551814732, 'recall': 0.9066170151818963, 'f1-score': 0.9151807228915662, 'support': 10473.0} | {'precision': 0.8905869877113093, 'recall': 0.8979810050946601, 'f1-score': 0.8942687128092702, 'support': 15899.0} | 0.8619 | {'precision': 0.8264339768637954, 'recall': 0.8289130145318692, 'f1-score': 0.8276266289344558, 'support': 33500.0} | {'precision': 0.8622479110808169, 'recall': 0.8618507462686568, 'f1-score': 0.8620104361623443, 'support': 33500.0} |
116
- | 0.0038 | 44.0 | 3564 | 1.2192 | {'precision': 0.6494427558257345, 'recall': 0.6487854251012146, 'f1-score': 0.649113924050633, 'support': 4940.0} | {'precision': 0.8391670358883474, 'recall': 0.8656307129798904, 'f1-score': 0.8521934758155231, 'support': 2188.0} | {'precision': 0.9273227263798861, 'recall': 0.9015563830803017, 'f1-score': 0.9142580488985719, 'support': 10473.0} | {'precision': 0.886704700483691, 'recall': 0.8993647399207497, 'f1-score': 0.8929898516783762, 'support': 15899.0} | 0.8609 | {'precision': 0.8256593046444147, 'recall': 0.8288343152705391, 'f1-score': 0.827138825110776, 'support': 33500.0} | {'precision': 0.8613108547662561, 'recall': 0.8608955223880597, 'f1-score': 0.8610117106819026, 'support': 33500.0} |
117
- | 0.0038 | 45.0 | 3645 | 1.2218 | {'precision': 0.6585365853658537, 'recall': 0.6340080971659919, 'f1-score': 0.6460396039603961, 'support': 4940.0} | {'precision': 0.8490310950878774, 'recall': 0.8610603290676416, 'f1-score': 0.85500340367597, 'support': 2188.0} | {'precision': 0.923443579766537, 'recall': 0.9064260479327795, 'f1-score': 0.9148556835156363, 'support': 10473.0} | {'precision': 0.8835949522930132, 'recall': 0.902824076985974, 'f1-score': 0.8931060228969636, 'support': 15899.0} | 0.8616 | {'precision': 0.8286515531283204, 'recall': 0.8260796377880968, 'f1-score': 0.8272511785122416, 'support': 33500.0} | {'precision': 0.8606075082137657, 'recall': 0.8615820895522388, 'f1-score': 0.8609838603673272, 'support': 33500.0} |
118
- | 0.0038 | 46.0 | 3726 | 1.2381 | {'precision': 0.6517081059227815, 'recall': 0.6526315789473685, 'f1-score': 0.6521695155254374, 'support': 4940.0} | {'precision': 0.8559011893870082, 'recall': 0.8551188299817185, 'f1-score': 0.8555098308184728, 'support': 2188.0} | {'precision': 0.9215743440233236, 'recall': 0.9054712116871957, 'f1-score': 0.9134518133217743, 'support': 10473.0} | {'precision': 0.8870436026621882, 'recall': 0.8969746524938675, 'f1-score': 0.8919814861145858, 'support': 15899.0} | 0.8609 | {'precision': 0.8290568104988254, 'recall': 0.8275490682775376, 'f1-score': 0.8282781614450676, 'support': 33500.0} | {'precision': 0.8611016175916333, 'recall': 0.8608656716417911, 'f1-score': 0.8609482807516783, 'support': 33500.0} |
119
- | 0.0038 | 47.0 | 3807 | 1.2339 | {'precision': 0.6445289057811562, 'recall': 0.6522267206477733, 'f1-score': 0.6483549652882584, 'support': 4940.0} | {'precision': 0.8536474852741278, 'recall': 0.8610603290676416, 'f1-score': 0.8573378839590444, 'support': 2188.0} | {'precision': 0.9263456090651558, 'recall': 0.9054712116871957, 'f1-score': 0.9157894736842105, 'support': 10473.0} | {'precision': 0.887712524132777, 'recall': 0.8965343732310208, 'f1-score': 0.8921016397546626, 'support': 15899.0} | 0.8610 | {'precision': 0.8280586310633042, 'recall': 0.8288231586584078, 'f1-score': 0.8283959906715441, 'support': 33500.0} | {'precision': 0.861704850067615, 'recall': 0.8609850746268657, 'f1-score': 0.8612930133427016, 'support': 33500.0} |
120
- | 0.0038 | 48.0 | 3888 | 1.2307 | {'precision': 0.6515679442508711, 'recall': 0.6435222672064778, 'f1-score': 0.6475201140645687, 'support': 4940.0} | {'precision': 0.8524886877828054, 'recall': 0.8610603290676416, 'f1-score': 0.8567530695770805, 'support': 2188.0} | {'precision': 0.9257454687195479, 'recall': 0.9070944333046882, 'f1-score': 0.9163250542560887, 'support': 10473.0} | {'precision': 0.8866183664623196, 'recall': 0.9005597836341909, 'f1-score': 0.8935346979530704, 'support': 15899.0} | 0.8621 | {'precision': 0.8291051168038859, 'recall': 0.8280592033032497, 'f1-score': 0.8285332339627021, 'support': 33500.0} | {'precision': 0.8619602565896216, 'recall': 0.8621194029850746, 'f1-score': 0.8619792697221943, 'support': 33500.0} |
121
- | 0.0038 | 49.0 | 3969 | 1.2301 | {'precision': 0.649795918367347, 'recall': 0.6445344129554655, 'f1-score': 0.6471544715447154, 'support': 4940.0} | {'precision': 0.8505643340857788, 'recall': 0.8610603290676416, 'f1-score': 0.8557801498977969, 'support': 2188.0} | {'precision': 0.9270436566070905, 'recall': 0.9063305643082211, 'f1-score': 0.9165701042873696, 'support': 10473.0} | {'precision': 0.8865972996407779, 'recall': 0.9003710925215422, 'f1-score': 0.8934311124980496, 'support': 15899.0} | 0.8619 | {'precision': 0.8285003021752486, 'recall': 0.8280740997132177, 'f1-score': 0.8282339595569829, 'support': 33500.0} | {'precision': 0.8619691129059451, 'recall': 0.8619402985074627, 'f1-score': 0.8618892542452355, 'support': 33500.0} |
122
- | 0.0027 | 50.0 | 4050 | 1.2317 | {'precision': 0.6477872513195291, 'recall': 0.6459514170040486, 'f1-score': 0.6468680316237584, 'support': 4940.0} | {'precision': 0.8505643340857788, 'recall': 0.8610603290676416, 'f1-score': 0.8557801498977969, 'support': 2188.0} | {'precision': 0.926710256660486, 'recall': 0.9067124988064547, 'f1-score': 0.9166023166023166, 'support': 10473.0} | {'precision': 0.8874751737835154, 'recall': 0.8993647399207497, 'f1-score': 0.8933804004873324, 'support': 15899.0} | 0.8618 | {'precision': 0.8281342539623273, 'recall': 0.8282722461997236, 'f1-score': 0.828157724652801, 'support': 33500.0} | {'precision': 0.8619853161339563, 'recall': 0.8617910447761195, 'f1-score': 0.8618330177111018, 'support': 33500.0} |
123
 
124
 
125
  ### Framework versions
 
17
  name: essays_su_g
18
  type: essays_su_g
19
  config: simple
20
+ split: train[80%:100%]
21
  args: simple
22
  metrics:
23
  - name: Accuracy
24
  type: accuracy
25
+ value: 0.8590463087005322
26
  ---
27
 
28
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
32
 
33
  This model is a fine-tuned version of [allenai/longformer-base-4096](https://huggingface.co/allenai/longformer-base-4096) on the essays_su_g dataset.
34
  It achieves the following results on the evaluation set:
35
+ - Loss: 1.1263
36
+ - Claim: {'precision': 0.6273854961832062, 'recall': 0.6309980806142035, 'f1-score': 0.6291866028708135, 'support': 4168.0}
37
+ - Majorclaim: {'precision': 0.8152077807250221, 'recall': 0.8568773234200744, 'f1-score': 0.8355233348436791, 'support': 2152.0}
38
+ - O: {'precision': 0.9466531895777179, 'recall': 0.9136137004118795, 'f1-score': 0.9298400441257586, 'support': 9226.0}
39
+ - Premise: {'precision': 0.8827175597422723, 'recall': 0.8964631823076286, 'f1-score': 0.889537272951426, 'support': 12073.0}
40
+ - Accuracy: 0.8590
41
+ - Macro avg: {'precision': 0.8179910065570546, 'recall': 0.8244880716884464, 'f1-score': 0.8210218136979194, 'support': 27619.0}
42
+ - Weighted avg: {'precision': 0.8602824620016775, 'recall': 0.8590463087005322, 'f1-score': 0.8595019269631762, 'support': 27619.0}
43
 
44
  ## Model description
45
 
 
68
 
69
  ### Training results
70
 
71
+ | Training Loss | Epoch | Step | Validation Loss | Claim | Majorclaim | O | Premise | Accuracy | Macro avg | Weighted avg |
72
+ |:-------------:|:-----:|:----:|:---------------:|:--------------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|:--------:|:-------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|
73
+ | No log | 1.0 | 81 | 0.5105 | {'precision': 0.5640703517587939, 'recall': 0.32317658349328215, 'f1-score': 0.41092129347162903, 'support': 4168.0} | {'precision': 0.5929304446978335, 'recall': 0.724907063197026, 'f1-score': 0.6523102655237298, 'support': 2152.0} | {'precision': 0.8545380875202593, 'recall': 0.9143724257533059, 'f1-score': 0.8834432924913603, 'support': 9226.0} | {'precision': 0.8441231929604023, 'recall': 0.8899196554294707, 'f1-score': 0.8664166767469054, 'support': 12073.0} | 0.7997 | {'precision': 0.7139155192343223, 'recall': 0.7130939319682712, 'f1-score': 0.7032728820584061, 'support': 27619.0} | {'precision': 0.7857670171690952, 'recall': 0.7997031029363844, 'f1-score': 0.7866826459135919, 'support': 27619.0} |
74
+ | No log | 2.0 | 162 | 0.4469 | {'precision': 0.5678977272727272, 'recall': 0.47960652591170827, 'f1-score': 0.5200312174817897, 'support': 4168.0} | {'precision': 0.7948320413436692, 'recall': 0.7146840148698885, 'f1-score': 0.7526302911671151, 'support': 2152.0} | {'precision': 0.944560669456067, 'recall': 0.8808801213960546, 'f1-score': 0.9116096466629278, 'support': 9226.0} | {'precision': 0.8259587020648967, 'recall': 0.9276898865236478, 'f1-score': 0.8738735224125151, 'support': 12073.0} | 0.8278 | {'precision': 0.7833122850343401, 'recall': 0.7507151371753248, 'f1-score': 0.7645361694310869, 'support': 27619.0} | {'precision': 0.8242076985653165, 'recall': 0.8278359100619139, 'f1-score': 0.8236335905447046, 'support': 27619.0} |
75
+ | No log | 3.0 | 243 | 0.4093 | {'precision': 0.5744204961366409, 'recall': 0.6777831094049904, 'f1-score': 0.6218357913273168, 'support': 4168.0} | {'precision': 0.7360824742268042, 'recall': 0.8294609665427509, 'f1-score': 0.7799868909766223, 'support': 2152.0} | {'precision': 0.9330596419204014, 'recall': 0.8868415347929763, 'f1-score': 0.9093637121422617, 'support': 9226.0} | {'precision': 0.89797514556357, 'recall': 0.855876749772219, 'f1-score': 0.876420695504665, 'support': 12073.0} | 0.8373 | {'precision': 0.7853844394618541, 'recall': 0.8124905901282342, 'f1-score': 0.7969017724877165, 'support': 27619.0} | {'precision': 0.8482528803063183, 'recall': 0.8372859263550454, 'f1-score': 0.8414917278933443, 'support': 27619.0} |
76
+ | No log | 4.0 | 324 | 0.5161 | {'precision': 0.516112873601603, 'recall': 0.7416026871401151, 'f1-score': 0.608644284729743, 'support': 4168.0} | {'precision': 0.7790381125226861, 'recall': 0.7978624535315985, 'f1-score': 0.788337924701561, 'support': 2152.0} | {'precision': 0.9442684500762643, 'recall': 0.8723173639713853, 'f1-score': 0.9068679925629612, 'support': 9226.0} | {'precision': 0.8985600293497202, 'recall': 0.8114801623457302, 'f1-score': 0.8528029247910863, 'support': 12073.0} | 0.8202 | {'precision': 0.7844948663875684, 'recall': 0.8058156667472073, 'f1-score': 0.789163281696338, 'support': 27619.0} | {'precision': 0.8468005514342695, 'recall': 0.8201962417176581, 'f1-score': 0.8289940404467937, 'support': 27619.0} |
77
+ | No log | 5.0 | 405 | 0.5154 | {'precision': 0.5811590856615101, 'recall': 0.6038867562380038, 'f1-score': 0.5923049770561243, 'support': 4168.0} | {'precision': 0.8014598540145985, 'recall': 0.7653345724907064, 'f1-score': 0.7829807463750891, 'support': 2152.0} | {'precision': 0.9311288483466362, 'recall': 0.8851073054411446, 'f1-score': 0.9075350077795066, 'support': 9226.0} | {'precision': 0.8633555323758325, 'recall': 0.891244926695933, 'f1-score': 0.8770785784153896, 'support': 12073.0} | 0.8360 | {'precision': 0.7942758300996444, 'recall': 0.7863933902164468, 'f1-score': 0.7899748274065275, 'support': 27619.0} | {'precision': 0.8385857117236715, 'recall': 0.8360186827908324, 'f1-score': 0.8369451960444566, 'support': 27619.0} |
78
+ | No log | 6.0 | 486 | 0.5418 | {'precision': 0.6108374384236454, 'recall': 0.5057581573896354, 'f1-score': 0.5533534584591154, 'support': 4168.0} | {'precision': 0.8107317073170732, 'recall': 0.7723048327137546, 'f1-score': 0.7910518800571156, 'support': 2152.0} | {'precision': 0.919331636605068, 'recall': 0.9004985909386516, 'f1-score': 0.909817664129661, 'support': 9226.0} | {'precision': 0.8410671966975002, 'recall': 0.9112896546011762, 'f1-score': 0.8747714081259442, 'support': 12073.0} | 0.8357 | {'precision': 0.7954919947608217, 'recall': 0.7724628089108043, 'f1-score': 0.782248602692959, 'support': 27619.0} | {'precision': 0.8301032992701898, 'recall': 0.8356566132010572, 'f1-score': 0.8314498656832355, 'support': 27619.0} |
79
+ | 0.345 | 7.0 | 567 | 0.5832 | {'precision': 0.6017184735911044, 'recall': 0.571257197696737, 'f1-score': 0.5860923076923077, 'support': 4168.0} | {'precision': 0.8264023210831721, 'recall': 0.7941449814126395, 'f1-score': 0.8099526066350711, 'support': 2152.0} | {'precision': 0.9157418381639909, 'recall': 0.9212009538261435, 'f1-score': 0.9184632841627491, 'support': 9226.0} | {'precision': 0.8666450093397222, 'recall': 0.8838731052762362, 'f1-score': 0.8751742803247764, 'support': 12073.0} | 0.8422 | {'precision': 0.8026269105444974, 'recall': 0.792619059552939, 'f1-score': 0.7974206197037261, 'support': 27619.0} | {'precision': 0.8399297508801243, 'recall': 0.84217386581701, 'f1-score': 0.8409273360363069, 'support': 27619.0} |
80
+ | 0.345 | 8.0 | 648 | 0.5916 | {'precision': 0.6281560826319816, 'recall': 0.5909309021113244, 'f1-score': 0.6089751514402275, 'support': 4168.0} | {'precision': 0.806993006993007, 'recall': 0.804368029739777, 'f1-score': 0.8056783802653014, 'support': 2152.0} | {'precision': 0.9243136825987094, 'recall': 0.9159982657706481, 'f1-score': 0.9201371876531113, 'support': 9226.0} | {'precision': 0.8721998388396455, 'recall': 0.8965460117617825, 'f1-score': 0.8842053669893396, 'support': 12073.0} | 0.8497 | {'precision': 0.8079156527658359, 'recall': 0.801960802345883, 'f1-score': 0.8047490215869949, 'support': 27619.0} | {'precision': 0.8476986926907486, 'recall': 0.8497411202433107, 'f1-score': 0.8485544514458778, 'support': 27619.0} |
81
+ | 0.345 | 9.0 | 729 | 0.6681 | {'precision': 0.5974557019536574, 'recall': 0.6309980806142035, 'f1-score': 0.6137689614935823, 'support': 4168.0} | {'precision': 0.761437908496732, 'recall': 0.8661710037174721, 'f1-score': 0.8104347826086956, 'support': 2152.0} | {'precision': 0.9265518003092555, 'recall': 0.9092781270323, 'f1-score': 0.9178336980306346, 'support': 9226.0} | {'precision': 0.8886043533930857, 'recall': 0.8622546177420691, 'f1-score': 0.8752312090129477, 'support': 12073.0} | 0.8434 | {'precision': 0.7935124410381827, 'recall': 0.8171754572765112, 'f1-score': 0.804317162786465, 'support': 27619.0} | {'precision': 0.8474346288061019, 'recall': 0.8433686954632681, 'f1-score': 0.8449561811840803, 'support': 27619.0} |
82
+ | 0.345 | 10.0 | 810 | 0.7243 | {'precision': 0.5741487455197133, 'recall': 0.6149232245681382, 'f1-score': 0.5938368860055606, 'support': 4168.0} | {'precision': 0.8037466547725245, 'recall': 0.837360594795539, 'f1-score': 0.8202093764223942, 'support': 2152.0} | {'precision': 0.9286033519553073, 'recall': 0.9008237589421201, 'f1-score': 0.9145026408450704, 'support': 9226.0} | {'precision': 0.8756164841594918, 'recall': 0.8676385322620724, 'f1-score': 0.8716092527874855, 'support': 12073.0} | 0.8382 | {'precision': 0.7955288091017592, 'recall': 0.8051865276419675, 'f1-score': 0.8000395390151277, 'support': 27619.0} | {'precision': 0.8422219164630815, 'recall': 0.8382273072884608, 'f1-score': 0.840013852502701, 'support': 27619.0} |
83
+ | 0.345 | 11.0 | 891 | 0.7493 | {'precision': 0.5898203592814372, 'recall': 0.614443378119002, 'f1-score': 0.6018801410105759, 'support': 4168.0} | {'precision': 0.8243443839683325, 'recall': 0.7741635687732342, 'f1-score': 0.7984663311766117, 'support': 2152.0} | {'precision': 0.9334944195144402, 'recall': 0.8793626707132018, 'f1-score': 0.9056203605514316, 'support': 9226.0} | {'precision': 0.8616792678074016, 'recall': 0.8967945001242442, 'f1-score': 0.878886273236464, 'support': 12073.0} | 0.8388 | {'precision': 0.8023346076429029, 'recall': 0.7911910294324205, 'f1-score': 0.7962132764937708, 'support': 27619.0} | {'precision': 0.8417333606018996, 'recall': 0.838806618632101, 'f1-score': 0.8397473983726959, 'support': 27619.0} |
84
+ | 0.345 | 12.0 | 972 | 0.7472 | {'precision': 0.5856969205834684, 'recall': 0.6936180422264875, 'f1-score': 0.6351054481546573, 'support': 4168.0} | {'precision': 0.7993659420289855, 'recall': 0.8201672862453532, 'f1-score': 0.8096330275229358, 'support': 2152.0} | {'precision': 0.9461520684076727, 'recall': 0.8874918707999133, 'f1-score': 0.9158836689038031, 'support': 9226.0} | {'precision': 0.8926486760849336, 'recall': 0.8740164002319225, 'f1-score': 0.8832342847576798, 'support': 12073.0} | 0.8471 | {'precision': 0.8059659017762651, 'recall': 0.8188233998759191, 'f1-score': 0.810964107334769, 'support': 27619.0} | {'precision': 0.8569306173916821, 'recall': 0.8470980122379521, 'f1-score': 0.8509605717920246, 'support': 27619.0} |
85
+ | 0.0604 | 13.0 | 1053 | 0.8128 | {'precision': 0.5960222412318221, 'recall': 0.6686660268714012, 'f1-score': 0.6302578018995931, 'support': 4168.0} | {'precision': 0.8172757475083057, 'recall': 0.800185873605948, 'f1-score': 0.8086405259450574, 'support': 2152.0} | {'precision': 0.9477475417333638, 'recall': 0.8984391935833514, 'f1-score': 0.9224348987313599, 'support': 9226.0} | {'precision': 0.8838709677419355, 'recall': 0.8851155470885447, 'f1-score': 0.8844928196002152, 'support': 12073.0} | 0.8503 | {'precision': 0.8112291245538568, 'recall': 0.8131016602873112, 'f1-score': 0.8114565115440564, 'support': 27619.0} | {'precision': 0.8565802934093382, 'recall': 0.8502842246279735, 'f1-score': 0.8528902247322565, 'support': 27619.0} |
86
+ | 0.0604 | 14.0 | 1134 | 0.8995 | {'precision': 0.6241429970617042, 'recall': 0.6115642994241842, 'f1-score': 0.6177896267571498, 'support': 4168.0} | {'precision': 0.7095697329376854, 'recall': 0.8889405204460966, 'f1-score': 0.7891914191419142, 'support': 2152.0} | {'precision': 0.9549846806504831, 'recall': 0.8783871667027965, 'f1-score': 0.915085817524842, 'support': 9226.0} | {'precision': 0.8733101270946328, 'recall': 0.8935641514122422, 'f1-score': 0.8833210513387375, 'support': 12073.0} | 0.8456 | {'precision': 0.7905018844361265, 'recall': 0.8181140344963299, 'f1-score': 0.8013469786906608, 'support': 27619.0} | {'precision': 0.850232952139105, 'recall': 0.8455773199608965, 'f1-score': 0.8465260836240982, 'support': 27619.0} |
87
+ | 0.0604 | 15.0 | 1215 | 0.9128 | {'precision': 0.5816304108987036, 'recall': 0.6350767754318618, 'f1-score': 0.6071797224452345, 'support': 4168.0} | {'precision': 0.7725922783198982, 'recall': 0.8461895910780669, 'f1-score': 0.8077178975382568, 'support': 2152.0} | {'precision': 0.9512505789717461, 'recall': 0.8904183828311294, 'f1-score': 0.9198298062926884, 'support': 9226.0} | {'precision': 0.8719668737060041, 'recall': 0.8721113227863828, 'f1-score': 0.8720390922643698, 'support': 12073.0} | 0.8404 | {'precision': 0.794360035474088, 'recall': 0.8109490180318603, 'f1-score': 0.8016916296351374, 'support': 27619.0} | {'precision': 0.8468933720777774, 'recall': 0.8404359317860893, 'f1-score': 0.8430215341764057, 'support': 27619.0} |
88
+ | 0.0604 | 16.0 | 1296 | 0.8803 | {'precision': 0.6304191616766467, 'recall': 0.6314779270633397, 'f1-score': 0.6309481002037637, 'support': 4168.0} | {'precision': 0.8195592286501377, 'recall': 0.8294609665427509, 'f1-score': 0.8244803695150116, 'support': 2152.0} | {'precision': 0.9101446193109315, 'recall': 0.9277043138955127, 'f1-score': 0.9188405797101449, 'support': 9226.0} | {'precision': 0.8933569381217332, 'recall': 0.8777437256688478, 'f1-score': 0.8854815124294965, 'support': 12073.0} | 0.8535 | {'precision': 0.8133699869398623, 'recall': 0.8165967332926127, 'f1-score': 0.8149376404646043, 'support': 27619.0} | {'precision': 0.8535345630772185, 'recall': 0.8535066439769724, 'f1-score': 0.8534601153123827, 'support': 27619.0} |
89
+ | 0.0604 | 17.0 | 1377 | 0.8617 | {'precision': 0.6221813161527842, 'recall': 0.6487523992322457, 'f1-score': 0.6351891003053795, 'support': 4168.0} | {'precision': 0.7972493345164152, 'recall': 0.8350371747211895, 'f1-score': 0.8157058556513844, 'support': 2152.0} | {'precision': 0.9221517603323858, 'recall': 0.914155647084327, 'f1-score': 0.9181362943609842, 'support': 9226.0} | {'precision': 0.8921923692411353, 'recall': 0.8774124078522323, 'f1-score': 0.8847406664996242, 'support': 12073.0} | 0.8519 | {'precision': 0.8084436950606801, 'recall': 0.8188394072224987, 'f1-score': 0.813442979204343, 'support': 27619.0} | {'precision': 0.8540549226358285, 'recall': 0.8518773308229842, 'f1-score': 0.8528573333523664, 'support': 27619.0} |
90
+ | 0.0604 | 18.0 | 1458 | 0.9965 | {'precision': 0.6335570469798658, 'recall': 0.5662188099808061, 'f1-score': 0.5979982262764474, 'support': 4168.0} | {'precision': 0.8203703703703704, 'recall': 0.8234200743494424, 'f1-score': 0.8218923933209649, 'support': 2152.0} | {'precision': 0.9406885581183957, 'recall': 0.8973553002384566, 'f1-score': 0.9185111222055806, 'support': 9226.0} | {'precision': 0.8547127503286167, 'recall': 0.9155967862171789, 'f1-score': 0.8841078141246101, 'support': 12073.0} | 0.8496 | {'precision': 0.8123321814493122, 'recall': 0.800647742696471, 'f1-score': 0.8056273889819007, 'support': 27619.0} | {'precision': 0.8473819646173586, 'recall': 0.8495962924074008, 'f1-score': 0.8475754477331567, 'support': 27619.0} |
91
+ | 0.0201 | 19.0 | 1539 | 0.9760 | {'precision': 0.5662385321100918, 'recall': 0.7404030710172744, 'f1-score': 0.6417134539405281, 'support': 4168.0} | {'precision': 0.8062157221206582, 'recall': 0.8197026022304833, 'f1-score': 0.8129032258064516, 'support': 2152.0} | {'precision': 0.9517297802711547, 'recall': 0.8826143507478864, 'f1-score': 0.9158699808795411, 'support': 9226.0} | {'precision': 0.8939168490153173, 'recall': 0.8459372152737513, 'f1-score': 0.8692654694016513, 'support': 12073.0} | 0.8402 | {'precision': 0.8045252208793054, 'recall': 0.8221643098173489, 'f1-score': 0.809938032507043, 'support': 27619.0} | {'precision': 0.8569454182549012, 'recall': 0.8402186900322242, 'f1-score': 0.8461018818074655, 'support': 27619.0} |
92
+ | 0.0201 | 20.0 | 1620 | 1.0000 | {'precision': 0.6002422774076317, 'recall': 0.7132917466410749, 'f1-score': 0.651902203705734, 'support': 4168.0} | {'precision': 0.8425531914893617, 'recall': 0.8280669144981413, 'f1-score': 0.8352472463088821, 'support': 2152.0} | {'precision': 0.9323666150099623, 'recall': 0.9129633644049425, 'f1-score': 0.9225629791894853, 'support': 9226.0} | {'precision': 0.8987583572110793, 'recall': 0.8573676799469891, 'f1-score': 0.8775752437473505, 'support': 12073.0} | 0.8519 | {'precision': 0.8184801102795087, 'recall': 0.8279224263727869, 'f1-score': 0.821821918237863, 'support': 27619.0} | {'precision': 0.8605564400235849, 'recall': 0.8519135377819617, 'f1-score': 0.8552486484979966, 'support': 27619.0} |
93
+ | 0.0201 | 21.0 | 1701 | 1.0823 | {'precision': 0.5819801980198019, 'recall': 0.7051343570057581, 'f1-score': 0.6376654371881102, 'support': 4168.0} | {'precision': 0.7559021922428331, 'recall': 0.83317843866171, 'f1-score': 0.792661361626879, 'support': 2152.0} | {'precision': 0.9542405366554864, 'recall': 0.8634294385432474, 'f1-score': 0.9065665187208377, 'support': 9226.0} | {'precision': 0.8881762174023125, 'recall': 0.8716971755156133, 'f1-score': 0.8798595435164284, 'support': 12073.0} | 0.8408 | {'precision': 0.7950747860801084, 'recall': 0.8183598524315823, 'f1-score': 0.8041882152630638, 'support': 27619.0} | {'precision': 0.8537300281304444, 'recall': 0.8407980013758645, 'f1-score': 0.8454369732073347, 'support': 27619.0} |
94
+ | 0.0201 | 22.0 | 1782 | 0.9630 | {'precision': 0.6159964648696421, 'recall': 0.6689059500959693, 'f1-score': 0.6413618587531631, 'support': 4168.0} | {'precision': 0.8129032258064516, 'recall': 0.8197026022304833, 'f1-score': 0.8162887552059233, 'support': 2152.0} | {'precision': 0.9430451554345359, 'recall': 0.9009321482766096, 'f1-score': 0.9215077605321508, 'support': 9226.0} | {'precision': 0.8838054339747295, 'recall': 0.886440818355007, 'f1-score': 0.8851211645025227, 'support': 12073.0} | 0.8533 | {'precision': 0.8139375700213398, 'recall': 0.8189953797395173, 'f1-score': 0.8160698847484399, 'support': 27619.0} | {'precision': 0.8576544630844016, 'recall': 0.8532531952641298, 'f1-score': 0.8551268346498754, 'support': 27619.0} |
95
+ | 0.0201 | 23.0 | 1863 | 1.0519 | {'precision': 0.6434384537131231, 'recall': 0.6070057581573897, 'f1-score': 0.6246913580246913, 'support': 4168.0} | {'precision': 0.8249312557286893, 'recall': 0.8364312267657993, 'f1-score': 0.8306414397784957, 'support': 2152.0} | {'precision': 0.9472960586617782, 'recall': 0.8961630175590722, 'f1-score': 0.9210203854294309, 'support': 9226.0} | {'precision': 0.8635830007043908, 'recall': 0.9139401971341009, 'f1-score': 0.8880482897384305, 'support': 12073.0} | 0.8556 | {'precision': 0.8198121922019954, 'recall': 0.8133850499040906, 'f1-score': 0.8161003682427621, 'support': 27619.0} | {'precision': 0.8553131736167897, 'recall': 0.8556428545566458, 'f1-score': 0.8548461217507599, 'support': 27619.0} |
96
+ | 0.0201 | 24.0 | 1944 | 1.0346 | {'precision': 0.605771270952684, 'recall': 0.6849808061420346, 'f1-score': 0.6429456142326315, 'support': 4168.0} | {'precision': 0.8141632837167343, 'recall': 0.8387546468401487, 'f1-score': 0.8262760357061112, 'support': 2152.0} | {'precision': 0.9483018430508867, 'recall': 0.8867331454584869, 'f1-score': 0.9164846244328684, 'support': 9226.0} | {'precision': 0.8831039628585641, 'recall': 0.8822993456473122, 'f1-score': 0.8827014708928941, 'support': 12073.0} | 0.8506 | {'precision': 0.8128350901447173, 'recall': 0.8231919860219956, 'f1-score': 0.8171019363161263, 'support': 27619.0} | {'precision': 0.8576588939305595, 'recall': 0.8506100872587712, 'f1-score': 0.8534083548306859, 'support': 27619.0} |
97
+ | 0.0091 | 25.0 | 2025 | 1.0354 | {'precision': 0.637881679389313, 'recall': 0.6415547024952015, 'f1-score': 0.6397129186602871, 'support': 4168.0} | {'precision': 0.798523664785063, 'recall': 0.8545539033457249, 'f1-score': 0.8255892255892255, 'support': 2152.0} | {'precision': 0.9484063288236643, 'recall': 0.8965965748970302, 'f1-score': 0.9217740138176956, 'support': 9226.0} | {'precision': 0.8766328011611031, 'recall': 0.9005218255611696, 'f1-score': 0.8884167517875383, 'support': 12073.0} | 0.8565 | {'precision': 0.8153611185397858, 'recall': 0.8233067515747815, 'f1-score': 0.8188732274636866, 'support': 27619.0} | {'precision': 0.8584922830101466, 'recall': 0.8565480285310837, 'f1-score': 0.8571321899510156, 'support': 27619.0} |
98
+ | 0.0091 | 26.0 | 2106 | 1.0637 | {'precision': 0.6577010910936311, 'recall': 0.6218809980806143, 'f1-score': 0.639289678135405, 'support': 4168.0} | {'precision': 0.8118231046931408, 'recall': 0.8359665427509294, 'f1-score': 0.8237179487179487, 'support': 2152.0} | {'precision': 0.9386496186630776, 'recall': 0.9071103403425103, 'f1-score': 0.9226105170323007, 'support': 9226.0} | {'precision': 0.8770125936553483, 'recall': 0.9113724840553301, 'f1-score': 0.8938624639506073, 'support': 12073.0} | 0.8604 | {'precision': 0.8212966020262995, 'recall': 0.8190825913073461, 'f1-score': 0.8198701519590654, 'support': 27619.0} | {'precision': 0.8594263331027361, 'recall': 0.8603859661827004, 'f1-score': 0.8595824092662689, 'support': 27619.0} |
99
+ | 0.0091 | 27.0 | 2187 | 1.0722 | {'precision': 0.6361293345829429, 'recall': 0.6513915547024952, 'f1-score': 0.643669985775249, 'support': 4168.0} | {'precision': 0.8111062527328378, 'recall': 0.8619888475836431, 'f1-score': 0.835773822933093, 'support': 2152.0} | {'precision': 0.9478951000690131, 'recall': 0.893236505527856, 'f1-score': 0.9197544642857143, 'support': 9226.0} | {'precision': 0.8817299919159256, 'recall': 0.9034208564565559, 'f1-score': 0.892443644397169, 'support': 12073.0} | 0.8588 | {'precision': 0.8192151698251797, 'recall': 0.8275094410676376, 'f1-score': 0.8229104793478063, 'support': 27619.0} | {'precision': 0.8612655819566406, 'recall': 0.8587566530287121, 'f1-score': 0.8596085511412532, 'support': 27619.0} |
100
+ | 0.0091 | 28.0 | 2268 | 1.0253 | {'precision': 0.654979674796748, 'recall': 0.6185220729366603, 'f1-score': 0.6362290227048372, 'support': 4168.0} | {'precision': 0.8579910935180604, 'recall': 0.8057620817843866, 'f1-score': 0.831056793673616, 'support': 2152.0} | {'precision': 0.9374237212914679, 'recall': 0.9157814871016692, 'f1-score': 0.9264762322495751, 'support': 9226.0} | {'precision': 0.8726381532136928, 'recall': 0.9142715149507165, 'f1-score': 0.8929698244478602, 'support': 12073.0} | 0.8617 | {'precision': 0.8307581607049922, 'recall': 0.8135842891933581, 'f1-score': 0.8216829682689721, 'support': 27619.0} | {'precision': 0.8602912413261778, 'recall': 0.8616894167058908, 'f1-score': 0.8605934753580137, 'support': 27619.0} |
101
+ | 0.0091 | 29.0 | 2349 | 1.0103 | {'precision': 0.6270194333879654, 'recall': 0.6425143953934741, 'f1-score': 0.6346723545443773, 'support': 4168.0} | {'precision': 0.8632949424136205, 'recall': 0.8011152416356877, 'f1-score': 0.8310436249698723, 'support': 2152.0} | {'precision': 0.9391839016210173, 'recall': 0.9105787990461739, 'f1-score': 0.9246601728028178, 'support': 9226.0} | {'precision': 0.8799774302756731, 'recall': 0.9042491509980949, 'f1-score': 0.8919482004983863, 'support': 12073.0} | 0.8588 | {'precision': 0.8273689269245691, 'recall': 0.8146143967683577, 'f1-score': 0.8205810882038633, 'support': 27619.0} | {'precision': 0.8602811798583894, 'recall': 0.8588290669466672, 'f1-score': 0.8593043062229604, 'support': 27619.0} |
102
+ | 0.0091 | 30.0 | 2430 | 1.0344 | {'precision': 0.6081264108352145, 'recall': 0.6463531669865643, 'f1-score': 0.6266573621772505, 'support': 4168.0} | {'precision': 0.7980556783031374, 'recall': 0.8392193308550185, 'f1-score': 0.8181200453001133, 'support': 2152.0} | {'precision': 0.9434216434665469, 'recall': 0.9109039670496423, 'f1-score': 0.9268776883202824, 'support': 9226.0} | {'precision': 0.8859211183225162, 'recall': 0.8818851983765427, 'f1-score': 0.8838985513262215, 'support': 12073.0} | 0.8527 | {'precision': 0.8088812127318536, 'recall': 0.819590415816942, 'f1-score': 0.8138884117809669, 'support': 27619.0} | {'precision': 0.8563604925666979, 'recall': 0.852710090879467, 'f1-score': 0.8543098224282204, 'support': 27619.0} |
103
+ | 0.0054 | 31.0 | 2511 | 1.0803 | {'precision': 0.6008753647353063, 'recall': 0.6916986564299424, 'f1-score': 0.6430961409770243, 'support': 4168.0} | {'precision': 0.8070973612374887, 'recall': 0.8243494423791822, 'f1-score': 0.8156321839080459, 'support': 2152.0} | {'precision': 0.948917649753751, 'recall': 0.8980056362453934, 'f1-score': 0.922759926491062, 'support': 9226.0} | {'precision': 0.8907669021190716, 'recall': 0.8774124078522323, 'f1-score': 0.884039223868141, 'support': 12073.0} | 0.8521 | {'precision': 0.8119143194614044, 'recall': 0.8228665357266876, 'f1-score': 0.8163818688110683, 'support': 27619.0} | {'precision': 0.8599248737286467, 'recall': 0.8521307795358268, 'f1-score': 0.85528273315214, 'support': 27619.0} |
104
+ | 0.0054 | 32.0 | 2592 | 1.0980 | {'precision': 0.6518208016767094, 'recall': 0.5969289827255279, 'f1-score': 0.6231684408265498, 'support': 4168.0} | {'precision': 0.823960880195599, 'recall': 0.7829925650557621, 'f1-score': 0.802954491303312, 'support': 2152.0} | {'precision': 0.9439581675571217, 'recall': 0.9000650336006937, 'f1-score': 0.9214892082339233, 'support': 9226.0} | {'precision': 0.8618055555555556, 'recall': 0.925122173444877, 'f1-score': 0.8923421084168898, 'support': 12073.0} | 0.8561 | {'precision': 0.8203863512462465, 'recall': 0.8012771887067152, 'f1-score': 0.8099885621951687, 'support': 27619.0} | {'precision': 0.8546105739408988, 'recall': 0.856149751982331, 'f1-score': 0.8544925535585312, 'support': 27619.0} |
105
+ | 0.0054 | 33.0 | 2673 | 1.1032 | {'precision': 0.6132238547968885, 'recall': 0.6809021113243762, 'f1-score': 0.645293315143247, 'support': 4168.0} | {'precision': 0.8150716597318539, 'recall': 0.8192379182156134, 'f1-score': 0.8171494785631519, 'support': 2152.0} | {'precision': 0.9452505100884153, 'recall': 0.9038586603078257, 'f1-score': 0.9240913120567376, 'support': 9226.0} | {'precision': 0.8901382642012328, 'recall': 0.8851983765426986, 'f1-score': 0.8876614477345405, 'support': 12073.0} | 0.8555 | {'precision': 0.8159210722045976, 'recall': 0.8222992665976285, 'f1-score': 0.8185488883744192, 'support': 27619.0} | {'precision': 0.8609099427319448, 'recall': 0.8554618197617582, 'f1-score': 0.8577606473413056, 'support': 27619.0} |
106
+ | 0.0054 | 34.0 | 2754 | 1.1183 | {'precision': 0.6371614844533601, 'recall': 0.6096449136276392, 'f1-score': 0.6230995586071605, 'support': 4168.0} | {'precision': 0.812132186509733, 'recall': 0.8336431226765799, 'f1-score': 0.8227470763586332, 'support': 2152.0} | {'precision': 0.9402985074626866, 'recall': 0.9081942336874052, 'f1-score': 0.9239675800849093, 'support': 9226.0} | {'precision': 0.875469586763648, 'recall': 0.9072310113476352, 'f1-score': 0.8910673608851285, 'support': 12073.0} | 0.8569 | {'precision': 0.8162654412973569, 'recall': 0.8146783203348149, 'f1-score': 0.8152203939839578, 'support': 27619.0} | {'precision': 0.856227085825657, 'recall': 0.8569100981208588, 'f1-score': 0.8562950074379215, 'support': 27619.0} |
107
+ | 0.0054 | 35.0 | 2835 | 1.1262 | {'precision': 0.6121336059986366, 'recall': 0.6463531669865643, 'f1-score': 0.6287781538102462, 'support': 4168.0} | {'precision': 0.8249312557286893, 'recall': 0.8364312267657993, 'f1-score': 0.8306414397784957, 'support': 2152.0} | {'precision': 0.9574964969640355, 'recall': 0.8887925428137872, 'f1-score': 0.9218662169758292, 'support': 9226.0} | {'precision': 0.8728351507376524, 'recall': 0.9016814379193241, 'f1-score': 0.8870238337746996, 'support': 12073.0} | 0.8538 | {'precision': 0.8168491273572535, 'recall': 0.8183145936213687, 'f1-score': 0.8170774110848177, 'support': 27619.0} | {'precision': 0.8580407106693336, 'recall': 0.853760092689815, 'f1-score': 0.8552975917471803, 'support': 27619.0} |
108
+ | 0.0054 | 36.0 | 2916 | 1.1356 | {'precision': 0.6130514705882353, 'recall': 0.6401151631477927, 'f1-score': 0.6262910798122067, 'support': 4168.0} | {'precision': 0.7958567112645663, 'recall': 0.8568773234200744, 'f1-score': 0.8252405459834415, 'support': 2152.0} | {'precision': 0.9530980572479595, 'recall': 0.8986559722523304, 'f1-score': 0.9250767085076709, 'support': 9226.0} | {'precision': 0.87943841319076, 'recall': 0.8924045390540877, 'f1-score': 0.8858740338760073, 'support': 12073.0} | 0.8537 | {'precision': 0.8103611630728802, 'recall': 0.8220132494685712, 'f1-score': 0.8156205920448316, 'support': 27619.0} | {'precision': 0.8573309971640839, 'recall': 0.8536514718128825, 'f1-score': 0.8550712842351443, 'support': 27619.0} |
109
+ | 0.0054 | 37.0 | 2997 | 1.1102 | {'precision': 0.6272071623974136, 'recall': 0.6050863723608445, 'f1-score': 0.6159482232262792, 'support': 4168.0} | {'precision': 0.8087902129587675, 'recall': 0.8294609665427509, 'f1-score': 0.81899518238128, 'support': 2152.0} | {'precision': 0.9405296229802513, 'recall': 0.9085194016908736, 'f1-score': 0.9242474363215348, 'support': 9226.0} | {'precision': 0.8751502524240724, 'recall': 0.9045804688147105, 'f1-score': 0.889622026718801, 'support': 12073.0} | 0.8548 | {'precision': 0.8129193126901262, 'recall': 0.8119118023522949, 'f1-score': 0.8122032171619737, 'support': 27619.0} | {'precision': 0.8544020887900109, 'recall': 0.8548463014591404, 'f1-score': 0.8543851480129697, 'support': 27619.0} |
110
+ | 0.0039 | 38.0 | 3078 | 1.0967 | {'precision': 0.6231203007518797, 'recall': 0.6362763915547025, 'f1-score': 0.6296296296296297, 'support': 4168.0} | {'precision': 0.8036028119507909, 'recall': 0.849907063197026, 'f1-score': 0.8261065943992774, 'support': 2152.0} | {'precision': 0.9439659993289341, 'recall': 0.9148059830912638, 'f1-score': 0.9291572631694831, 'support': 9226.0} | {'precision': 0.885394368516384, 'recall': 0.8907479499710097, 'f1-score': 0.8880630909616417, 'support': 12073.0} | 0.8572 | {'precision': 0.8140208701369972, 'recall': 0.8229343469535004, 'f1-score': 0.8182391445400079, 'support': 27619.0} | {'precision': 0.8590070308758098, 'recall': 0.857199753792679, 'f1-score': 0.8579625726718959, 'support': 27619.0} |
111
+ | 0.0039 | 39.0 | 3159 | 1.1243 | {'precision': 0.6262814538676608, 'recall': 0.6449136276391555, 'f1-score': 0.6354609929078013, 'support': 4168.0} | {'precision': 0.7901023890784983, 'recall': 0.8605947955390335, 'f1-score': 0.8238434163701068, 'support': 2152.0} | {'precision': 0.9577708549671167, 'recall': 0.8997398655972252, 'f1-score': 0.9278488794500642, 'support': 9226.0} | {'precision': 0.8812926274764534, 'recall': 0.8990308953863994, 'f1-score': 0.8900733937430809, 'support': 12073.0} | 0.8579 | {'precision': 0.8138618313474322, 'recall': 0.8260697960404534, 'f1-score': 0.8193066706177633, 'support': 27619.0} | {'precision': 0.8612506332766275, 'recall': 0.8579238929722293, 'f1-score': 0.8591079436234004, 'support': 27619.0} |
112
+ | 0.0039 | 40.0 | 3240 | 1.1121 | {'precision': 0.6214638527166592, 'recall': 0.6641074856046065, 'f1-score': 0.6420784040825794, 'support': 4168.0} | {'precision': 0.8057118130679359, 'recall': 0.8652416356877324, 'f1-score': 0.8344163118978265, 'support': 2152.0} | {'precision': 0.9444382211269183, 'recall': 0.9138304790808585, 'f1-score': 0.9288822784112818, 'support': 9226.0} | {'precision': 0.8936027500628826, 'recall': 0.8827963223722356, 'f1-score': 0.8881666666666668, 'support': 12073.0} | 0.8588 | {'precision': 0.816304159243599, 'recall': 0.8314939806863582, 'f1-score': 0.8233859152645886, 'support': 27619.0} | {'precision': 0.8626672287002196, 'recall': 0.8587928599876896, 'f1-score': 0.8604421144396781, 'support': 27619.0} |
113
+ | 0.0039 | 41.0 | 3321 | 1.1615 | {'precision': 0.5966553852279515, 'recall': 0.7190499040307101, 'f1-score': 0.6521597214666522, 'support': 4168.0} | {'precision': 0.8222222222222222, 'recall': 0.8252788104089219, 'f1-score': 0.823747680890538, 'support': 2152.0} | {'precision': 0.9584831265220921, 'recall': 0.8958378495556037, 'f1-score': 0.9261023026500084, 'support': 9226.0} | {'precision': 0.8921527131126725, 'recall': 0.8729396173279218, 'f1-score': 0.8824415975885456, 'support': 12073.0} | 0.8537 | {'precision': 0.8173783617712345, 'recall': 0.8282765453307894, 'f1-score': 0.821112825648936, 'support': 27619.0} | {'precision': 0.8642676019607676, 'recall': 0.8536514718128825, 'f1-score': 0.857701002218941, 'support': 27619.0} |
114
+ | 0.0039 | 42.0 | 3402 | 1.1097 | {'precision': 0.6225523295070898, 'recall': 0.6636276391554703, 'f1-score': 0.6424340959238184, 'support': 4168.0} | {'precision': 0.8328716528162512, 'recall': 0.8382899628252788, 'f1-score': 0.8355720240852247, 'support': 2152.0} | {'precision': 0.9516516173276945, 'recall': 0.9024495989594624, 'f1-score': 0.9263977746870653, 'support': 9226.0} | {'precision': 0.8826360003262377, 'recall': 0.8963803528534747, 'f1-score': 0.889455083422372, 'support': 12073.0} | 0.8588 | {'precision': 0.8224278999943182, 'recall': 0.8251868884484215, 'f1-score': 0.8234647445296202, 'support': 27619.0} | {'precision': 0.8625634584760528, 'recall': 0.8587566530287121, 'f1-score': 0.860319106378328, 'support': 27619.0} |
115
+ | 0.0039 | 43.0 | 3483 | 1.1389 | {'precision': 0.6155963302752293, 'recall': 0.6439539347408829, 'f1-score': 0.6294559099437148, 'support': 4168.0} | {'precision': 0.8046532045654082, 'recall': 0.8517657992565055, 'f1-score': 0.8275395033860045, 'support': 2152.0} | {'precision': 0.9582417582417583, 'recall': 0.897897246910904, 'f1-score': 0.9270885792624923, 'support': 9226.0} | {'precision': 0.8781614785992218, 'recall': 0.8972914768491675, 'f1-score': 0.8876234175918718, 'support': 12073.0} | 0.8557 | {'precision': 0.8141631929204045, 'recall': 0.8227271144393651, 'f1-score': 0.8179268525460208, 'support': 27619.0} | {'precision': 0.8595604907302502, 'recall': 0.8557152684746008, 'f1-score': 0.8571647777542455, 'support': 27619.0} |
116
+ | 0.0026 | 44.0 | 3564 | 1.1342 | {'precision': 0.6240409207161125, 'recall': 0.6439539347408829, 'f1-score': 0.6338410674223639, 'support': 4168.0} | {'precision': 0.799826313504125, 'recall': 0.8559479553903345, 'f1-score': 0.8269360269360269, 'support': 2152.0} | {'precision': 0.9584583429494576, 'recall': 0.9002818122696726, 'f1-score': 0.9284596467695059, 'support': 9226.0} | {'precision': 0.8793424568790995, 'recall': 0.8994450426571688, 'f1-score': 0.8892801572352798, 'support': 12073.0} | 0.8578 | {'precision': 0.8154170085121986, 'recall': 0.8249071862645148, 'f1-score': 0.819629224590794, 'support': 27619.0} | {'precision': 0.861047356463257, 'recall': 0.8577790651363192, 'f1-score': 0.8589617270132784, 'support': 27619.0} |
117
+ | 0.0026 | 45.0 | 3645 | 1.1367 | {'precision': 0.6169934640522876, 'recall': 0.6794625719769674, 'f1-score': 0.6467229961178351, 'support': 4168.0} | {'precision': 0.812694185530404, 'recall': 0.8508364312267658, 'f1-score': 0.831328036322361, 'support': 2152.0} | {'precision': 0.9527514014414826, 'recall': 0.9026663776284414, 'f1-score': 0.927032893638337, 'support': 9226.0} | {'precision': 0.8909846281678437, 'recall': 0.8881802368922389, 'f1-score': 0.8895802223328355, 'support': 12073.0} | 0.8586 | {'precision': 0.8183559197980044, 'recall': 0.8302864044311034, 'f1-score': 0.8236660371028421, 'support': 27619.0} | {'precision': 0.864169176689991, 'recall': 0.8586118251928021, 'f1-score': 0.8609025266271941, 'support': 27619.0} |
118
+ | 0.0026 | 46.0 | 3726 | 1.1422 | {'precision': 0.6169026169026169, 'recall': 0.6900191938579654, 'f1-score': 0.6514156285390714, 'support': 4168.0} | {'precision': 0.8026828212894851, 'recall': 0.8619888475836431, 'f1-score': 0.8312794084696392, 'support': 2152.0} | {'precision': 0.9538074548364966, 'recall': 0.9041838283112942, 'f1-score': 0.9283329623859337, 'support': 9226.0} | {'precision': 0.8952941176470588, 'recall': 0.8824650045556199, 'f1-score': 0.8888332707629416, 'support': 12073.0} | 0.8591 | {'precision': 0.8171717526689144, 'recall': 0.8346642185771307, 'f1-score': 0.8249653175393965, 'support': 27619.0} | {'precision': 0.8656119699967246, 'recall': 0.8590825156595098, 'f1-score': 0.8617146752478776, 'support': 27619.0} |
119
+ | 0.0026 | 47.0 | 3807 | 1.1345 | {'precision': 0.6162966156499246, 'recall': 0.6859404990403071, 'f1-score': 0.6492562734188714, 'support': 4168.0} | {'precision': 0.8003449762828806, 'recall': 0.862453531598513, 'f1-score': 0.8302393200626258, 'support': 2152.0} | {'precision': 0.9542955326460482, 'recall': 0.9029915456319099, 'f1-score': 0.927934952105146, 'support': 9226.0} | {'precision': 0.8938060514625765, 'recall': 0.8832932990971589, 'f1-score': 0.8885185802366272, 'support': 12073.0} | 0.8585 | {'precision': 0.8161857940103575, 'recall': 0.8336697188419722, 'f1-score': 0.8239872814558176, 'support': 27619.0} | {'precision': 0.8648509260469159, 'recall': 0.858466997356892, 'f1-score': 0.8610372515914226, 'support': 27619.0} |
120
+ | 0.0026 | 48.0 | 3888 | 1.1346 | {'precision': 0.6188230008984726, 'recall': 0.6609884836852208, 'f1-score': 0.6392111368909513, 'support': 4168.0} | {'precision': 0.8088363954505686, 'recall': 0.8592007434944238, 'f1-score': 0.8332582244254167, 'support': 2152.0} | {'precision': 0.9490855723639647, 'recall': 0.9112291350531108, 'f1-score': 0.9297721742977217, 'support': 9226.0} | {'precision': 0.8901272560924894, 'recall': 0.886440818355007, 'f1-score': 0.8882802124833998, 'support': 12073.0} | 0.8586 | {'precision': 0.8167180562013739, 'recall': 0.8294647951469407, 'f1-score': 0.8226304370243724, 'support': 27619.0} | {'precision': 0.8625453508160694, 'recall': 0.8585756182338246, 'f1-score': 0.8602660778054183, 'support': 27619.0} |
121
+ | 0.0026 | 49.0 | 3969 | 1.1303 | {'precision': 0.6245327102803738, 'recall': 0.6413147792706334, 'f1-score': 0.6328125, 'support': 4168.0} | {'precision': 0.810989010989011, 'recall': 0.8573420074349443, 'f1-score': 0.8335215721707703, 'support': 2152.0} | {'precision': 0.9477242000901307, 'recall': 0.9117710817255582, 'f1-score': 0.9294000662910176, 'support': 9226.0} | {'precision': 0.8852149655398753, 'recall': 0.893646980866396, 'f1-score': 0.8894109888298091, 'support': 12073.0} | 0.8588 | {'precision': 0.8171152217248476, 'recall': 0.826018712324383, 'f1-score': 0.8212862818228992, 'support': 27619.0} | {'precision': 0.8609726795717226, 'recall': 0.8587928599876896, 'f1-score': 0.8596909664743367, 'support': 27619.0} |
122
+ | 0.0024 | 50.0 | 4050 | 1.1263 | {'precision': 0.6273854961832062, 'recall': 0.6309980806142035, 'f1-score': 0.6291866028708135, 'support': 4168.0} | {'precision': 0.8152077807250221, 'recall': 0.8568773234200744, 'f1-score': 0.8355233348436791, 'support': 2152.0} | {'precision': 0.9466531895777179, 'recall': 0.9136137004118795, 'f1-score': 0.9298400441257586, 'support': 9226.0} | {'precision': 0.8827175597422723, 'recall': 0.8964631823076286, 'f1-score': 0.889537272951426, 'support': 12073.0} | 0.8590 | {'precision': 0.8179910065570546, 'recall': 0.8244880716884464, 'f1-score': 0.8210218136979194, 'support': 27619.0} | {'precision': 0.8602824620016775, 'recall': 0.8590463087005322, 'f1-score': 0.8595019269631762, 'support': 27619.0} |
123
 
124
 
125
  ### Framework versions