Update spacy pipeline to 3.5.3
Browse files- README.md +29 -29
- config.cfg +4 -4
- experimental_arc_labeler/model +1 -1
- experimental_arc_predicter/model +1 -1
- hu_core_news_trf-any-py3-none-any.whl +2 -2
- meta.json +191 -197
- morphologizer/model +1 -1
- ner/model +1 -1
- senter/model +1 -1
- tagger/model +1 -1
- trainable_lemmatizer/model +1 -1
- trainable_lemmatizer/trees +0 -0
- transformer/model +1 -1
- vocab/strings.json +2 -2
README.md
CHANGED
@@ -14,74 +14,74 @@ model-index:
|
|
14 |
metrics:
|
15 |
- name: NER Precision
|
16 |
type: precision
|
17 |
-
value: 0.
|
18 |
- name: NER Recall
|
19 |
type: recall
|
20 |
-
value: 0.
|
21 |
- name: NER F Score
|
22 |
type: f_score
|
23 |
-
value: 0.
|
24 |
- task:
|
25 |
name: TAG
|
26 |
type: token-classification
|
27 |
metrics:
|
28 |
- name: TAG (XPOS) Accuracy
|
29 |
type: accuracy
|
30 |
-
value: 0.
|
31 |
- task:
|
32 |
name: POS
|
33 |
type: token-classification
|
34 |
metrics:
|
35 |
- name: POS (UPOS) Accuracy
|
36 |
type: accuracy
|
37 |
-
value: 0.
|
38 |
- task:
|
39 |
name: MORPH
|
40 |
type: token-classification
|
41 |
metrics:
|
42 |
- name: Morph (UFeats) Accuracy
|
43 |
type: accuracy
|
44 |
-
value: 0.
|
45 |
- task:
|
46 |
name: LEMMA
|
47 |
type: token-classification
|
48 |
metrics:
|
49 |
- name: Lemma Accuracy
|
50 |
type: accuracy
|
51 |
-
value: 0.
|
52 |
- task:
|
53 |
name: UNLABELED_DEPENDENCIES
|
54 |
type: token-classification
|
55 |
metrics:
|
56 |
- name: Unlabeled Attachment Score (UAS)
|
57 |
type: f_score
|
58 |
-
value: 0.
|
59 |
- task:
|
60 |
name: LABELED_DEPENDENCIES
|
61 |
type: token-classification
|
62 |
metrics:
|
63 |
- name: Labeled Attachment Score (LAS)
|
64 |
type: f_score
|
65 |
-
value: 0.
|
66 |
- task:
|
67 |
name: SENTS
|
68 |
type: token-classification
|
69 |
metrics:
|
70 |
- name: Sentences F-Score
|
71 |
type: f_score
|
72 |
-
value: 0.
|
73 |
---
|
74 |
Hungarian transformer pipeline (huBERT) for HuSpaCy. Components: transformer, senter, tagger, morphologizer, lemmatizer, parser, ner
|
75 |
|
76 |
| Feature | Description |
|
77 |
| --- | --- |
|
78 |
| **Name** | `hu_core_news_trf` |
|
79 |
-
| **Version** | `3.5.
|
80 |
| **spaCy** | `>=3.5.0,<3.6.0` |
|
81 |
| **Default Pipeline** | `transformer`, `senter`, `tagger`, `morphologizer`, `lookup_lemmatizer`, `trainable_lemmatizer`, `experimental_arc_predicter`, `experimental_arc_labeler`, `ner` |
|
82 |
| **Components** | `transformer`, `senter`, `tagger`, `morphologizer`, `lookup_lemmatizer`, `trainable_lemmatizer`, `experimental_arc_predicter`, `experimental_arc_labeler`, `ner` |
|
83 |
| **Vectors** | 0 keys, 0 unique vectors (0 dimensions) |
|
84 |
-
| **Sources** | [UD Hungarian Szeged](https://universaldependencies.org/treebanks/hu_szeged/index.html) (Richárd Farkas, Katalin Simkó, Zsolt Szántó, Viktor Varga, Veronika Vincze (MTA-SZTE Research Group on Artificial Intelligence))<br />[NYTK-NerKor Corpus](https://github.com/nytud/NYTK-NerKor) (Eszter Simon, Noémi Vadász (Department of Language Technology and Applied Linguistics))<br />[
|
85 |
| **License** | `cc-by-sa-4.0` |
|
86 |
| **Author** | [SzegedAI, MILAB](https://github.com/huspacy/huspacy) |
|
87 |
|
@@ -108,20 +108,20 @@ Hungarian transformer pipeline (huBERT) for HuSpaCy. Components: transformer, se
|
|
108 |
| `TOKEN_P` | 99.86 |
|
109 |
| `TOKEN_R` | 99.93 |
|
110 |
| `TOKEN_F` | 99.89 |
|
111 |
-
| `SENTS_P` | 99.
|
112 |
-
| `SENTS_R` | 99.
|
113 |
-
| `SENTS_F` | 99.
|
114 |
-
| `TAG_ACC` | 98.
|
115 |
-
| `POS_ACC` |
|
116 |
-
| `MORPH_ACC` | 96.
|
117 |
-
| `MORPH_MICRO_P` | 98.
|
118 |
-
| `MORPH_MICRO_R` | 98.
|
119 |
-
| `MORPH_MICRO_F` | 98.
|
120 |
-
| `LEMMA_ACC` | 98.
|
121 |
-
| `BOUND_DEP_LAS` |
|
122 |
-
| `BOUND_DEP_UAS` |
|
123 |
-
| `DEP_UAS` |
|
124 |
-
| `DEP_LAS` |
|
125 |
-
| `ENTS_P` |
|
126 |
-
| `ENTS_R` |
|
127 |
-
| `ENTS_F` | 91.
|
|
|
14 |
metrics:
|
15 |
- name: NER Precision
|
16 |
type: precision
|
17 |
+
value: 0.9121680264
|
18 |
- name: NER Recall
|
19 |
type: recall
|
20 |
+
value: 0.9238748242
|
21 |
- name: NER F Score
|
22 |
type: f_score
|
23 |
+
value: 0.9179841034
|
24 |
- task:
|
25 |
name: TAG
|
26 |
type: token-classification
|
27 |
metrics:
|
28 |
- name: TAG (XPOS) Accuracy
|
29 |
type: accuracy
|
30 |
+
value: 0.9831092397
|
31 |
- task:
|
32 |
name: POS
|
33 |
type: token-classification
|
34 |
metrics:
|
35 |
- name: POS (UPOS) Accuracy
|
36 |
type: accuracy
|
37 |
+
value: 0.9825350495
|
38 |
- task:
|
39 |
name: MORPH
|
40 |
type: token-classification
|
41 |
metrics:
|
42 |
- name: Morph (UFeats) Accuracy
|
43 |
type: accuracy
|
44 |
+
value: 0.9674610011
|
45 |
- task:
|
46 |
name: LEMMA
|
47 |
type: token-classification
|
48 |
metrics:
|
49 |
- name: Lemma Accuracy
|
50 |
type: accuracy
|
51 |
+
value: 0.9882307913
|
52 |
- task:
|
53 |
name: UNLABELED_DEPENDENCIES
|
54 |
type: token-classification
|
55 |
metrics:
|
56 |
- name: Unlabeled Attachment Score (UAS)
|
57 |
type: f_score
|
58 |
+
value: 0.8952581463
|
59 |
- task:
|
60 |
name: LABELED_DEPENDENCIES
|
61 |
type: token-classification
|
62 |
metrics:
|
63 |
- name: Labeled Attachment Score (LAS)
|
64 |
type: f_score
|
65 |
+
value: 0.8520574163
|
66 |
- task:
|
67 |
name: SENTS
|
68 |
type: token-classification
|
69 |
metrics:
|
70 |
- name: Sentences F-Score
|
71 |
type: f_score
|
72 |
+
value: 0.9933184855
|
73 |
---
|
74 |
Hungarian transformer pipeline (huBERT) for HuSpaCy. Components: transformer, senter, tagger, morphologizer, lemmatizer, parser, ner
|
75 |
|
76 |
| Feature | Description |
|
77 |
| --- | --- |
|
78 |
| **Name** | `hu_core_news_trf` |
|
79 |
+
| **Version** | `3.5.3` |
|
80 |
| **spaCy** | `>=3.5.0,<3.6.0` |
|
81 |
| **Default Pipeline** | `transformer`, `senter`, `tagger`, `morphologizer`, `lookup_lemmatizer`, `trainable_lemmatizer`, `experimental_arc_predicter`, `experimental_arc_labeler`, `ner` |
|
82 |
| **Components** | `transformer`, `senter`, `tagger`, `morphologizer`, `lookup_lemmatizer`, `trainable_lemmatizer`, `experimental_arc_predicter`, `experimental_arc_labeler`, `ner` |
|
83 |
| **Vectors** | 0 keys, 0 unique vectors (0 dimensions) |
|
84 |
+
| **Sources** | [UD Hungarian Szeged](https://universaldependencies.org/treebanks/hu_szeged/index.html) (Richárd Farkas, Katalin Simkó, Zsolt Szántó, Viktor Varga, Veronika Vincze (MTA-SZTE Research Group on Artificial Intelligence))<br />[NYTK-NerKor Corpus](https://github.com/nytud/NYTK-NerKor) (Eszter Simon, Noémi Vadász (Department of Language Technology and Applied Linguistics))<br />[Szeged NER Corpus](https://rgai.inf.u-szeged.hu/node/130) (György Szarvas, Richárd Farkas, László Felföldi, András Kocsor, János Csirik (MTA-SZTE Research Group on Artificial Intelligence))<br />[huBERT base model (cased)](https://huggingface.co/SZTAKI-HLT/hubert-base-cc) (Dávid Márk Nemeskey (SZTAKI-HLT)) |
|
85 |
| **License** | `cc-by-sa-4.0` |
|
86 |
| **Author** | [SzegedAI, MILAB](https://github.com/huspacy/huspacy) |
|
87 |
|
|
|
108 |
| `TOKEN_P` | 99.86 |
|
109 |
| `TOKEN_R` | 99.93 |
|
110 |
| `TOKEN_F` | 99.89 |
|
111 |
+
| `SENTS_P` | 99.33 |
|
112 |
+
| `SENTS_R` | 99.33 |
|
113 |
+
| `SENTS_F` | 99.33 |
|
114 |
+
| `TAG_ACC` | 98.31 |
|
115 |
+
| `POS_ACC` | 98.25 |
|
116 |
+
| `MORPH_ACC` | 96.75 |
|
117 |
+
| `MORPH_MICRO_P` | 98.81 |
|
118 |
+
| `MORPH_MICRO_R` | 98.58 |
|
119 |
+
| `MORPH_MICRO_F` | 98.69 |
|
120 |
+
| `LEMMA_ACC` | 98.82 |
|
121 |
+
| `BOUND_DEP_LAS` | 85.22 |
|
122 |
+
| `BOUND_DEP_UAS` | 89.54 |
|
123 |
+
| `DEP_UAS` | 89.53 |
|
124 |
+
| `DEP_LAS` | 85.21 |
|
125 |
+
| `ENTS_P` | 91.22 |
|
126 |
+
| `ENTS_R` | 92.39 |
|
127 |
+
| `ENTS_F` | 91.80 |
|
config.cfg
CHANGED
@@ -1,8 +1,8 @@
|
|
1 |
[paths]
|
2 |
-
tagger_model = "models/hu_core_news_trf-tagger-3.5.
|
3 |
-
parser_model = "models/hu_core_news_trf-parser-3.5.
|
4 |
-
ner_model = "models/hu_core_news_trf-ner-3.5.
|
5 |
-
lemmatizer_lookups = "models/hu_core_news_trf-lookup-lemmatizer-3.5.
|
6 |
train = null
|
7 |
dev = null
|
8 |
vectors = null
|
|
|
1 |
[paths]
|
2 |
+
tagger_model = "models/hu_core_news_trf-tagger-3.5.3/model-best"
|
3 |
+
parser_model = "models/hu_core_news_trf-parser-3.5.3/model-best"
|
4 |
+
ner_model = "models/hu_core_news_trf-ner-3.5.3/model-best"
|
5 |
+
lemmatizer_lookups = "models/hu_core_news_trf-lookup-lemmatizer-3.5.3"
|
6 |
train = null
|
7 |
dev = null
|
8 |
vectors = null
|
experimental_arc_labeler/model
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 14947179
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:fb415ca51404d8e5a100885d6fb66892562d745e3e1f45b99671daa5db833f8b
|
3 |
size 14947179
|
experimental_arc_predicter/model
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 413192
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:4b1205f330e7aa342fdb28984d530e7bdf7ba776a995364c21d4d57a8c87b2d0
|
3 |
size 413192
|
hu_core_news_trf-any-py3-none-any.whl
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8dcef8d1b79a67fdd9185b3062a07b182480d5cc0c4028fb0ee3397607cbb1e8
|
3 |
+
size 1266435135
|
meta.json
CHANGED
@@ -1,7 +1,7 @@
|
|
1 |
{
|
2 |
"lang":"hu",
|
3 |
"name":"core_news_trf",
|
4 |
-
"version":"3.5.
|
5 |
"description":"Hungarian transformer pipeline (huBERT) for HuSpaCy. Components: transformer, senter, tagger, morphologizer, lemmatizer, parser, ner",
|
6 |
"author":"SzegedAI, MILAB",
|
7 |
"email":"[email protected]",
|
@@ -1281,222 +1281,222 @@
|
|
1281 |
"token_p":0.998565417,
|
1282 |
"token_r":0.9993300153,
|
1283 |
"token_f":0.9989475698,
|
1284 |
-
"sents_p":0.
|
1285 |
-
"sents_r":0.
|
1286 |
-
"sents_f":0.
|
1287 |
-
"tag_acc":0.
|
1288 |
-
"pos_acc":0.
|
1289 |
-
"morph_acc":0.
|
1290 |
-
"morph_micro_p":0.
|
1291 |
-
"morph_micro_r":0.
|
1292 |
-
"morph_micro_f":0.
|
1293 |
"morph_per_feat":{
|
1294 |
"Definite":{
|
1295 |
-
"p":0.
|
1296 |
-
"r":0.
|
1297 |
-
"f":0.
|
1298 |
},
|
1299 |
"PronType":{
|
1300 |
-
"p":0.
|
1301 |
-
"r":0.
|
1302 |
-
"f":0.
|
1303 |
},
|
1304 |
"Case":{
|
1305 |
-
"p":0.
|
1306 |
-
"r":0.
|
1307 |
-
"f":0.
|
1308 |
},
|
1309 |
"Degree":{
|
1310 |
-
"p":0.
|
1311 |
-
"r":0.
|
1312 |
-
"f":0.
|
1313 |
},
|
1314 |
"Number":{
|
1315 |
-
"p":0.
|
1316 |
-
"r":0.
|
1317 |
-
"f":0.
|
1318 |
},
|
1319 |
"Mood":{
|
1320 |
-
"p":0.
|
1321 |
-
"r":0.
|
1322 |
-
"f":0.
|
1323 |
},
|
1324 |
"Person":{
|
1325 |
-
"p":0.
|
1326 |
-
"r":0.
|
1327 |
-
"f":0.
|
1328 |
},
|
1329 |
"Tense":{
|
1330 |
-
"p":0.
|
1331 |
-
"r":0.
|
1332 |
-
"f":0.
|
1333 |
},
|
1334 |
"VerbForm":{
|
1335 |
-
"p":0.
|
1336 |
-
"r":0.
|
1337 |
-
"f":0.
|
1338 |
},
|
1339 |
"Voice":{
|
1340 |
-
"p":0.
|
1341 |
"r":0.9867075665,
|
1342 |
-
"f":0.
|
1343 |
},
|
1344 |
"Number[psor]":{
|
1345 |
-
"p":0.
|
1346 |
-
"r":0.
|
1347 |
-
"f":0.
|
1348 |
},
|
1349 |
"Person[psor]":{
|
1350 |
-
"p":0.
|
1351 |
"r":0.9928673324,
|
1352 |
-
"f":0.
|
|
|
|
|
|
|
|
|
|
|
1353 |
},
|
1354 |
"NumType":{
|
1355 |
-
"p":0.
|
1356 |
-
"r":0.
|
1357 |
-
"f":0.
|
1358 |
},
|
1359 |
"Reflex":{
|
1360 |
-
"p":
|
1361 |
"r":0.875,
|
1362 |
-
"f":0.
|
1363 |
},
|
1364 |
"Aspect":{
|
1365 |
"p":0.0,
|
1366 |
"r":0.0,
|
1367 |
"f":0.0
|
1368 |
},
|
1369 |
-
"Number[psed]":{
|
1370 |
-
"p":1.0,
|
1371 |
-
"r":0.3333333333,
|
1372 |
-
"f":0.5
|
1373 |
-
},
|
1374 |
"Poss":{
|
1375 |
-
"p":
|
1376 |
"r":1.0,
|
1377 |
-
"f":
|
1378 |
}
|
1379 |
},
|
1380 |
-
"lemma_acc":0.
|
1381 |
-
"bound_dep_las":0.
|
1382 |
-
"bound_dep_uas":0.
|
1383 |
-
"dep_uas":0.
|
1384 |
-
"dep_las":0.
|
1385 |
"dep_las_per_type":{
|
1386 |
"415":{
|
1387 |
-
"p":0.
|
1388 |
-
"r":0.
|
1389 |
-
"f":0.
|
1390 |
},
|
1391 |
"7411097074813287689":{
|
1392 |
-
"p":0.
|
1393 |
-
"r":0.
|
1394 |
-
"f":0.
|
1395 |
},
|
1396 |
"429":{
|
1397 |
-
"p":0.
|
1398 |
-
"r":0.
|
1399 |
-
"f":0.
|
1400 |
},
|
1401 |
"15861261214731031920":{
|
1402 |
-
"p":0.
|
1403 |
-
"r":0.
|
1404 |
-
"f":0.
|
1405 |
},
|
1406 |
"991268021520064439":{
|
1407 |
-
"p":0.
|
1408 |
-
"r":0.
|
1409 |
-
"f":0.
|
1410 |
},
|
1411 |
"435":{
|
1412 |
-
"p":0.
|
1413 |
-
"r":0.
|
1414 |
-
"f":0.
|
1415 |
},
|
1416 |
"434":{
|
1417 |
-
"p":0.
|
1418 |
-
"r":0.
|
1419 |
-
"f":0.
|
1420 |
},
|
1421 |
"8206900633647566924":{
|
1422 |
-
"p":0.
|
1423 |
-
"r":0.
|
1424 |
-
"f":0.
|
1425 |
},
|
1426 |
"407":{
|
1427 |
-
"p":0.
|
1428 |
-
"r":0.
|
1429 |
-
"f":0.
|
1430 |
},
|
1431 |
"410":{
|
1432 |
-
"p":0.
|
1433 |
-
"r":0.
|
1434 |
-
"f":0.
|
1435 |
},
|
1436 |
"445":{
|
1437 |
-
"p":0.
|
1438 |
-
"r":0.
|
1439 |
-
"f":0.
|
1440 |
},
|
1441 |
"400":{
|
1442 |
-
"p":0.
|
1443 |
-
"r":0.
|
1444 |
-
"f":0.
|
1445 |
},
|
1446 |
"17772752594865228322":{
|
1447 |
-
"p":0.
|
1448 |
-
"r":0.
|
1449 |
-
"f":0.
|
1450 |
},
|
1451 |
"403":{
|
1452 |
-
"p":0.
|
1453 |
-
"r":0.
|
1454 |
-
"f":0.
|
1455 |
},
|
1456 |
"399":{
|
1457 |
-
"p":0.
|
1458 |
-
"r":0.
|
1459 |
-
"f":0.
|
1460 |
},
|
1461 |
"3143985677199705895":{
|
1462 |
-
"p":0.
|
1463 |
-
"r":0.
|
1464 |
-
"f":0.
|
1465 |
},
|
1466 |
"9241468201421778905":{
|
1467 |
-
"p":0.
|
1468 |
-
"r":0.
|
1469 |
-
"f":0.
|
1470 |
},
|
1471 |
"423":{
|
1472 |
-
"p":0.
|
1473 |
-
"r":0.
|
1474 |
-
"f":0.
|
1475 |
},
|
1476 |
"13543738850102096385":{
|
1477 |
-
"p":0.
|
1478 |
-
"r":0.
|
1479 |
-
"f":0.
|
1480 |
},
|
1481 |
"10901028881100056900":{
|
1482 |
-
"p":0.
|
1483 |
-
"r":0.
|
1484 |
-
"f":0.
|
1485 |
},
|
1486 |
"411":{
|
1487 |
-
"p":0.
|
1488 |
"r":0.7317073171,
|
1489 |
-
"f":0.
|
1490 |
},
|
1491 |
"12549387360942434255":{
|
1492 |
-
"p":0.
|
1493 |
-
"r":0.
|
1494 |
-
"f":0.
|
1495 |
},
|
1496 |
"303601073839818384":{
|
1497 |
-
"p":0.
|
1498 |
-
"r":0.
|
1499 |
-
"f":0.
|
1500 |
},
|
1501 |
"8884235091647096537":{
|
1502 |
"p":0.0,
|
@@ -1504,74 +1504,64 @@
|
|
1504 |
"f":0.0
|
1505 |
},
|
1506 |
"2249809950233855422":{
|
1507 |
-
"p":0.
|
1508 |
-
"r":0.
|
1509 |
-
"f":0.
|
1510 |
},
|
1511 |
"422":{
|
1512 |
-
"p":0.
|
1513 |
-
"r":0.
|
1514 |
-
"f":0.
|
1515 |
-
},
|
1516 |
-
"408":{
|
1517 |
-
"p":0.1333333333,
|
1518 |
-
"r":0.1538461538,
|
1519 |
-
"f":0.1428571429
|
1520 |
},
|
1521 |
"8110129090154140942":{
|
1522 |
-
"p":0.
|
1523 |
-
"r":0.
|
1524 |
-
"f":0.
|
1525 |
},
|
1526 |
"412":{
|
1527 |
-
"p":0.
|
1528 |
-
"r":0.
|
1529 |
-
"f":0.
|
1530 |
},
|
1531 |
"436":{
|
1532 |
-
"p":0.
|
1533 |
-
"r":0.
|
1534 |
-
"f":0.
|
1535 |
},
|
1536 |
"450":{
|
1537 |
-
"p":0.
|
1538 |
-
"r":0.
|
1539 |
-
"f":0.
|
1540 |
},
|
1541 |
"12837356684637874264":{
|
1542 |
-
"p":0.
|
1543 |
-
"r":0.
|
1544 |
-
"f":0.
|
1545 |
-
},
|
1546 |
-
"3350290345017230236":{
|
1547 |
-
"p":0.1666666667,
|
1548 |
-
"r":0.0416666667,
|
1549 |
-
"f":0.0666666667
|
1550 |
},
|
1551 |
"451":{
|
1552 |
-
"p":0.
|
1553 |
-
"r":0.
|
1554 |
-
"f":0.
|
1555 |
},
|
1556 |
"7349492218059511525":{
|
1557 |
-
"p":0.
|
1558 |
-
"r":
|
1559 |
-
"f":0.
|
1560 |
},
|
1561 |
"426":{
|
1562 |
-
"p":
|
1563 |
-
"r":0.
|
1564 |
-
"f":0.
|
1565 |
},
|
1566 |
"405":{
|
1567 |
-
"p":0.
|
1568 |
-
"r":0.
|
1569 |
-
"f":0.
|
1570 |
},
|
1571 |
"17865338459503383721":{
|
1572 |
-
"p":
|
1573 |
"r":0.1666666667,
|
1574 |
-
"f":0.
|
1575 |
},
|
1576 |
"17311980334327143026":{
|
1577 |
"p":0.0,
|
@@ -1588,15 +1578,25 @@
|
|
1588 |
"r":0.0,
|
1589 |
"f":0.0
|
1590 |
},
|
|
|
|
|
|
|
|
|
|
|
1591 |
"10069665988847657778":{
|
1592 |
"p":0.0,
|
1593 |
"r":0.0,
|
1594 |
"f":0.0
|
1595 |
},
|
1596 |
"17473201795025412735":{
|
1597 |
-
"p":0.
|
1598 |
"r":0.1666666667,
|
1599 |
-
"f":0.
|
|
|
|
|
|
|
|
|
|
|
1600 |
},
|
1601 |
"6522094215780122214":{
|
1602 |
"p":1.0,
|
@@ -1609,32 +1609,32 @@
|
|
1609 |
"f":0.0
|
1610 |
}
|
1611 |
},
|
1612 |
-
"ents_p":0.
|
1613 |
-
"ents_r":0.
|
1614 |
-
"ents_f":0.
|
1615 |
"ents_per_type":{
|
1616 |
"ORG":{
|
1617 |
-
"p":0.
|
1618 |
-
"r":0.
|
1619 |
-
"f":0.
|
1620 |
},
|
1621 |
"PER":{
|
1622 |
-
"p":0.
|
1623 |
-
"r":0.
|
1624 |
-
"f":0.
|
1625 |
},
|
1626 |
"LOC":{
|
1627 |
-
"p":0.
|
1628 |
-
"r":0.
|
1629 |
-
"f":0.
|
1630 |
},
|
1631 |
"MISC":{
|
1632 |
-
"p":0.
|
1633 |
"r":0.7787234043,
|
1634 |
-
"f":0.
|
1635 |
}
|
1636 |
},
|
1637 |
-
"speed":
|
1638 |
},
|
1639 |
"sources":[
|
1640 |
{
|
@@ -1649,12 +1649,6 @@
|
|
1649 |
"license":"CC BY-SA 4.0",
|
1650 |
"author":"Eszter Simon, No\u00e9mi Vad\u00e1sz (Department of Language Technology and Applied Linguistics)"
|
1651 |
},
|
1652 |
-
{
|
1653 |
-
"name":"hunNERwiki",
|
1654 |
-
"url":"http://hlt.sztaki.hu/resources/hunnerwiki.html",
|
1655 |
-
"license":"CC-BY-SA-3.0",
|
1656 |
-
"author":"Eszter Simon, D\u00e1vid M\u00e1rk Nemeskey (HLT Group, Budapest University of Technology and Economics)"
|
1657 |
-
},
|
1658 |
{
|
1659 |
"name":"Szeged NER Corpus",
|
1660 |
"url":"https://rgai.inf.u-szeged.hu/node/130",
|
|
|
1 |
{
|
2 |
"lang":"hu",
|
3 |
"name":"core_news_trf",
|
4 |
+
"version":"3.5.3",
|
5 |
"description":"Hungarian transformer pipeline (huBERT) for HuSpaCy. Components: transformer, senter, tagger, morphologizer, lemmatizer, parser, ner",
|
6 |
"author":"SzegedAI, MILAB",
|
7 |
"email":"[email protected]",
|
|
|
1281 |
"token_p":0.998565417,
|
1282 |
"token_r":0.9993300153,
|
1283 |
"token_f":0.9989475698,
|
1284 |
+
"sents_p":0.9933184855,
|
1285 |
+
"sents_r":0.9933184855,
|
1286 |
+
"sents_f":0.9933184855,
|
1287 |
+
"tag_acc":0.9831092397,
|
1288 |
+
"pos_acc":0.9825350495,
|
1289 |
+
"morph_acc":0.9674610011,
|
1290 |
+
"morph_micro_p":0.9880685734,
|
1291 |
+
"morph_micro_r":0.9857756768,
|
1292 |
+
"morph_micro_f":0.9869207934,
|
1293 |
"morph_per_feat":{
|
1294 |
"Definite":{
|
1295 |
+
"p":0.9920449228,
|
1296 |
+
"r":0.9892673822,
|
1297 |
+
"f":0.9906542056
|
1298 |
},
|
1299 |
"PronType":{
|
1300 |
+
"p":0.9884169884,
|
1301 |
+
"r":0.9889624724,
|
1302 |
+
"f":0.9886896552
|
1303 |
},
|
1304 |
"Case":{
|
1305 |
+
"p":0.9932793042,
|
1306 |
+
"r":0.9928867813,
|
1307 |
+
"f":0.993083004
|
1308 |
},
|
1309 |
"Degree":{
|
1310 |
+
"p":0.9472789116,
|
1311 |
+
"r":0.9267886855,
|
1312 |
+
"f":0.936921783
|
1313 |
},
|
1314 |
"Number":{
|
1315 |
+
"p":0.9949740325,
|
1316 |
+
"r":0.9953075247,
|
1317 |
+
"f":0.9951407507
|
1318 |
},
|
1319 |
"Mood":{
|
1320 |
+
"p":0.985619469,
|
1321 |
+
"r":0.987804878,
|
1322 |
+
"f":0.9867109635
|
1323 |
},
|
1324 |
"Person":{
|
1325 |
+
"p":0.9772542648,
|
1326 |
+
"r":0.9893092105,
|
1327 |
+
"f":0.9832447895
|
1328 |
},
|
1329 |
"Tense":{
|
1330 |
+
"p":0.9944751381,
|
1331 |
+
"r":0.9944751381,
|
1332 |
+
"f":0.9944751381
|
1333 |
},
|
1334 |
"VerbForm":{
|
1335 |
+
"p":0.9924686192,
|
1336 |
+
"r":0.9510825982,
|
1337 |
+
"f":0.9713349713
|
1338 |
},
|
1339 |
"Voice":{
|
1340 |
+
"p":0.9846938776,
|
1341 |
"r":0.9867075665,
|
1342 |
+
"f":0.9856996936
|
1343 |
},
|
1344 |
"Number[psor]":{
|
1345 |
+
"p":0.99002849,
|
1346 |
+
"r":0.99002849,
|
1347 |
+
"f":0.99002849
|
1348 |
},
|
1349 |
"Person[psor]":{
|
1350 |
+
"p":0.9914529915,
|
1351 |
"r":0.9928673324,
|
1352 |
+
"f":0.9921596579
|
1353 |
+
},
|
1354 |
+
"Number[psed]":{
|
1355 |
+
"p":0.8,
|
1356 |
+
"r":0.4444444444,
|
1357 |
+
"f":0.5714285714
|
1358 |
},
|
1359 |
"NumType":{
|
1360 |
+
"p":0.9366197183,
|
1361 |
+
"r":0.9731707317,
|
1362 |
+
"f":0.9545454545
|
1363 |
},
|
1364 |
"Reflex":{
|
1365 |
+
"p":0.875,
|
1366 |
"r":0.875,
|
1367 |
+
"f":0.875
|
1368 |
},
|
1369 |
"Aspect":{
|
1370 |
"p":0.0,
|
1371 |
"r":0.0,
|
1372 |
"f":0.0
|
1373 |
},
|
|
|
|
|
|
|
|
|
|
|
1374 |
"Poss":{
|
1375 |
+
"p":0.75,
|
1376 |
"r":1.0,
|
1377 |
+
"f":0.8571428571
|
1378 |
}
|
1379 |
},
|
1380 |
+
"lemma_acc":0.9882307913,
|
1381 |
+
"bound_dep_las":0.8522205207,
|
1382 |
+
"bound_dep_uas":0.8953866769,
|
1383 |
+
"dep_uas":0.8952581463,
|
1384 |
+
"dep_las":0.8520574163,
|
1385 |
"dep_las_per_type":{
|
1386 |
"415":{
|
1387 |
+
"p":0.9417398244,
|
1388 |
+
"r":0.9394904459,
|
1389 |
+
"f":0.9406137904
|
1390 |
},
|
1391 |
"7411097074813287689":{
|
1392 |
+
"p":0.9087974173,
|
1393 |
+
"r":0.9206868357,
|
1394 |
+
"f":0.9147034931
|
1395 |
},
|
1396 |
"429":{
|
1397 |
+
"p":0.8983050847,
|
1398 |
+
"r":0.9109375,
|
1399 |
+
"f":0.9045771916
|
1400 |
},
|
1401 |
"15861261214731031920":{
|
1402 |
+
"p":0.7593582888,
|
1403 |
+
"r":0.6960784314,
|
1404 |
+
"f":0.726342711
|
1405 |
},
|
1406 |
"991268021520064439":{
|
1407 |
+
"p":0.8785357737,
|
1408 |
+
"r":0.8949152542,
|
1409 |
+
"f":0.8866498741
|
1410 |
},
|
1411 |
"435":{
|
1412 |
+
"p":0.8637931034,
|
1413 |
+
"r":0.901890189,
|
1414 |
+
"f":0.8824306473
|
1415 |
},
|
1416 |
"434":{
|
1417 |
+
"p":0.9456521739,
|
1418 |
+
"r":0.9775280899,
|
1419 |
+
"f":0.9613259669
|
1420 |
},
|
1421 |
"8206900633647566924":{
|
1422 |
+
"p":0.8150943396,
|
1423 |
+
"r":0.9621380846,
|
1424 |
+
"f":0.8825331971
|
1425 |
},
|
1426 |
"407":{
|
1427 |
+
"p":0.8069815195,
|
1428 |
+
"r":0.8273684211,
|
1429 |
+
"f":0.817047817
|
1430 |
},
|
1431 |
"410":{
|
1432 |
+
"p":0.7730496454,
|
1433 |
+
"r":0.68125,
|
1434 |
+
"f":0.7242524917
|
1435 |
},
|
1436 |
"445":{
|
1437 |
+
"p":0.8453747468,
|
1438 |
+
"r":0.8465179175,
|
1439 |
+
"f":0.8459459459
|
1440 |
},
|
1441 |
"400":{
|
1442 |
+
"p":0.8645833333,
|
1443 |
+
"r":0.8736842105,
|
1444 |
+
"f":0.8691099476
|
1445 |
},
|
1446 |
"17772752594865228322":{
|
1447 |
+
"p":0.9466019417,
|
1448 |
+
"r":0.9112149533,
|
1449 |
+
"f":0.9285714286
|
1450 |
},
|
1451 |
"403":{
|
1452 |
+
"p":0.606741573,
|
1453 |
+
"r":0.5744680851,
|
1454 |
+
"f":0.5901639344
|
1455 |
},
|
1456 |
"399":{
|
1457 |
+
"p":0.3868613139,
|
1458 |
+
"r":0.5408163265,
|
1459 |
+
"f":0.4510638298
|
1460 |
},
|
1461 |
"3143985677199705895":{
|
1462 |
+
"p":0.7626459144,
|
1463 |
+
"r":0.852173913,
|
1464 |
+
"f":0.8049281314
|
1465 |
},
|
1466 |
"9241468201421778905":{
|
1467 |
+
"p":0.3023255814,
|
1468 |
+
"r":0.3939393939,
|
1469 |
+
"f":0.3421052632
|
1470 |
},
|
1471 |
"423":{
|
1472 |
+
"p":0.9225806452,
|
1473 |
+
"r":0.9050632911,
|
1474 |
+
"f":0.9137380192
|
1475 |
},
|
1476 |
"13543738850102096385":{
|
1477 |
+
"p":0.9351851852,
|
1478 |
+
"r":0.9266055046,
|
1479 |
+
"f":0.930875576
|
1480 |
},
|
1481 |
"10901028881100056900":{
|
1482 |
+
"p":0.8928571429,
|
1483 |
+
"r":0.78125,
|
1484 |
+
"f":0.8333333333
|
1485 |
},
|
1486 |
"411":{
|
1487 |
+
"p":0.8823529412,
|
1488 |
"r":0.7317073171,
|
1489 |
+
"f":0.8
|
1490 |
},
|
1491 |
"12549387360942434255":{
|
1492 |
+
"p":0.4571428571,
|
1493 |
+
"r":0.4,
|
1494 |
+
"f":0.4266666667
|
1495 |
},
|
1496 |
"303601073839818384":{
|
1497 |
+
"p":0.75,
|
1498 |
+
"r":0.375,
|
1499 |
+
"f":0.5
|
1500 |
},
|
1501 |
"8884235091647096537":{
|
1502 |
"p":0.0,
|
|
|
1504 |
"f":0.0
|
1505 |
},
|
1506 |
"2249809950233855422":{
|
1507 |
+
"p":0.3913043478,
|
1508 |
+
"r":0.28125,
|
1509 |
+
"f":0.3272727273
|
1510 |
},
|
1511 |
"422":{
|
1512 |
+
"p":0.375,
|
1513 |
+
"r":0.8,
|
1514 |
+
"f":0.5106382979
|
|
|
|
|
|
|
|
|
|
|
1515 |
},
|
1516 |
"8110129090154140942":{
|
1517 |
+
"p":0.9692307692,
|
1518 |
+
"r":0.9642857143,
|
1519 |
+
"f":0.9667519182
|
1520 |
},
|
1521 |
"412":{
|
1522 |
+
"p":0.6315789474,
|
1523 |
+
"r":0.3243243243,
|
1524 |
+
"f":0.4285714286
|
1525 |
},
|
1526 |
"436":{
|
1527 |
+
"p":0.3157894737,
|
1528 |
+
"r":0.0821917808,
|
1529 |
+
"f":0.1304347826
|
1530 |
},
|
1531 |
"450":{
|
1532 |
+
"p":0.96,
|
1533 |
+
"r":0.972972973,
|
1534 |
+
"f":0.966442953
|
1535 |
},
|
1536 |
"12837356684637874264":{
|
1537 |
+
"p":0.6551724138,
|
1538 |
+
"r":0.6129032258,
|
1539 |
+
"f":0.6333333333
|
|
|
|
|
|
|
|
|
|
|
1540 |
},
|
1541 |
"451":{
|
1542 |
+
"p":0.4807692308,
|
1543 |
+
"r":0.3472222222,
|
1544 |
+
"f":0.4032258065
|
1545 |
},
|
1546 |
"7349492218059511525":{
|
1547 |
+
"p":0.6666666667,
|
1548 |
+
"r":0.8,
|
1549 |
+
"f":0.7272727273
|
1550 |
},
|
1551 |
"426":{
|
1552 |
+
"p":0.6,
|
1553 |
+
"r":0.2727272727,
|
1554 |
+
"f":0.375
|
1555 |
},
|
1556 |
"405":{
|
1557 |
+
"p":0.9166666667,
|
1558 |
+
"r":0.9166666667,
|
1559 |
+
"f":0.9166666667
|
1560 |
},
|
1561 |
"17865338459503383721":{
|
1562 |
+
"p":0.3333333333,
|
1563 |
"r":0.1666666667,
|
1564 |
+
"f":0.2222222222
|
1565 |
},
|
1566 |
"17311980334327143026":{
|
1567 |
"p":0.0,
|
|
|
1578 |
"r":0.0,
|
1579 |
"f":0.0
|
1580 |
},
|
1581 |
+
"3350290345017230236":{
|
1582 |
+
"p":0.0,
|
1583 |
+
"r":0.0,
|
1584 |
+
"f":0.0
|
1585 |
+
},
|
1586 |
"10069665988847657778":{
|
1587 |
"p":0.0,
|
1588 |
"r":0.0,
|
1589 |
"f":0.0
|
1590 |
},
|
1591 |
"17473201795025412735":{
|
1592 |
+
"p":0.1111111111,
|
1593 |
"r":0.1666666667,
|
1594 |
+
"f":0.1333333333
|
1595 |
+
},
|
1596 |
+
"408":{
|
1597 |
+
"p":0.0,
|
1598 |
+
"r":0.0,
|
1599 |
+
"f":0.0
|
1600 |
},
|
1601 |
"6522094215780122214":{
|
1602 |
"p":1.0,
|
|
|
1609 |
"f":0.0
|
1610 |
}
|
1611 |
},
|
1612 |
+
"ents_p":0.9121680264,
|
1613 |
+
"ents_r":0.9238748242,
|
1614 |
+
"ents_f":0.9179841034,
|
1615 |
"ents_per_type":{
|
1616 |
"ORG":{
|
1617 |
+
"p":0.9296551724,
|
1618 |
+
"r":0.9374130737,
|
1619 |
+
"f":0.9335180055
|
1620 |
},
|
1621 |
"PER":{
|
1622 |
+
"p":0.9427235535,
|
1623 |
+
"r":0.9635603345,
|
1624 |
+
"f":0.953028065
|
1625 |
},
|
1626 |
"LOC":{
|
1627 |
+
"p":0.9402985075,
|
1628 |
+
"r":0.9296875,
|
1629 |
+
"f":0.9349628983
|
1630 |
},
|
1631 |
"MISC":{
|
1632 |
+
"p":0.745923913,
|
1633 |
"r":0.7787234043,
|
1634 |
+
"f":0.7619708536
|
1635 |
}
|
1636 |
},
|
1637 |
+
"speed":3075.1123333576
|
1638 |
},
|
1639 |
"sources":[
|
1640 |
{
|
|
|
1649 |
"license":"CC BY-SA 4.0",
|
1650 |
"author":"Eszter Simon, No\u00e9mi Vad\u00e1sz (Department of Language Technology and Applied Linguistics)"
|
1651 |
},
|
|
|
|
|
|
|
|
|
|
|
|
|
1652 |
{
|
1653 |
"name":"Szeged NER Corpus",
|
1654 |
"url":"https://rgai.inf.u-szeged.hu/node/130",
|
morphologizer/model
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 3522673
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:ad795837e3057eaaddb2d8004674ee0f5eceaea131a13c2606c67bcae66f151a
|
3 |
size 3522673
|
ner/model
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 443884420
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d1db8479716f8dbd964226ba0cc3be73b92a20f9f2c91f71727d274999c2098f
|
3 |
size 443884420
|
senter/model
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 6792
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:2d9560d873a7691947932096d2492fee2bef9bc8df690d048241056e70be77cd
|
3 |
size 6792
|
tagger/model
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 52932
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:4aacfb2a645012bc47a0c2eb3c48458f6d749500674d4c2e1dc937d0496bcee9
|
3 |
size 52932
|
trainable_lemmatizer/model
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 455959169
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e6710bf3538f17d19184489a163fd6adae772800da8c67f7965896b5f745c3fa
|
3 |
size 455959169
|
trainable_lemmatizer/trees
CHANGED
Binary files a/trainable_lemmatizer/trees and b/trainable_lemmatizer/trees differ
|
|
transformer/model
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 443602220
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:0a72b2247afcca07de20bc57c19afd053f46108798158e1b3192521b058c56ca
|
3 |
size 443602220
|
vocab/strings.json
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b53dd9706ec7f856b63debedcc17bd3df3f7c8be9e0e9b72231f2990fac9b1f4
|
3 |
+
size 6387620
|