readme: ---
  language: 
  - multilingual
  - ace
  - afr
  - als
  - amh
  - ang
  - ara
  - arg
  - arz
  - asm
  - ast
  - ava
  - aym
  - azb
  - aze
  - bak
  - bar
  - bcl
  - bel
  - ben
  - bho
  - bjn
  - bod
  - bos
  - bpy
  - bre
  - bul
  - bxr
  - cat
  - cbk
  - cdo
  - ceb
  - ces
  - che
  - chr
  - chv
  - ckb
  - cor
  - cos
  - crh
  - csb
  - cym
  - dan
  - deu
  - diq
  - div
  - dsb
  - dty
  - egl
  - ell
  - eng
  - epo
  - est
  - eus
  - ext
  - fao
  - fas
  - fin
  - fra
  - frp
  - fry
  - fur
  - gag
  - gla
  - gle
  - glg
  - glk
  - glv
  - grn
  - guj
  - hak
  - hat
  - hau
  - hbs
  - heb
  - hif
  - hin
  - hrv
  - hsb
  - hun
  - hye
  - ibo
  - ido
  - ile
  - ilo
  - ina
  - ind
  - isl
  - ita
  - jam
  - jav
  - jbo
  - jpn
  - kaa
  - kab
  - kan
  - kat
  - kaz
  - kbd
  - khm
  - kin
  - kir
  - koi
  - kok
  - kom
  - kor
  - krc
  - ksh
  - kur
  - lad
  - lao
  - lat
  - lav
  - lez
  - lij
  - lim
  - lin
  - lit
  - lmo
  - lrc
  - ltg
  - ltz
  - lug
  - lzh
  - mai
  - mal
  - mar
  - mdf
  - mhr
  - min
  - mkd
  - mlg
  - mlt
  - nan
  - mon
  - mri
  - mrj
  - msa
  - mwl
  - mya
  - myv
  - mzn
  - nap
  - nav
  - nci
  - nds
  - nep
  - new
  - nld
  - nno
  - nob
  - nrm
  - nso
  - oci
  - olo
  - ori
  - orm
  - oss
  - pag
  - pam
  - pan
  - pap
  - pcd
  - pdc
  - pfl
  - pnb
  - pol
  - por
  - pus
  - que
  - roh
  - ron
  - rue
  - rup
  - rus
  - sah
  - san
  - scn
  - sco
  - sgs
  - sin
  - slk
  - slv
  - sme
  - sna
  - snd
  - som
  - spa
  - sqi
  - srd
  - srn
  - srp
  - stq
  - sun
  - swa
  - swe
  - szl
  - tam
  - tat
  - tcy
  - tel
  - tet
  - tgk
  - tgl
  - tha
  - ton
  - tsn
  - tuk
  - tur
  - tyv
  - udm
  - uig
  - ukr
  - urd
  - uzb
  - vec
  - vep
  - vie
  - vls
  - vol
  - vro
  - war
  - wln
  - wol
  - wuu
  - xho
  - xmf
  - yid
  - yor
  - zea
  - zho
  language_bcp47:
  - be-tarask
  - map-bms
  - nds-nl
  - roa-tara
  - zh-yue
  license: apache-2.0
  datasets:
  - wili_2018
  ---
  
  # Zabanshenas - Language Detector
  
  Zabanshenas is a Transformer-based solution for identifying the most likely language of a written document/text. Zabanshenas is a Persian word that has two meanings:
  
  - A person who studies linguistics.
  - A way to identify the type of written language.
  
  
  ## How to use
  
  Follow [Zabanshenas repo](https://github.com/m3hrdadfi/zabanshenas) for more information!
  
  
  ## Evaluation
  The following tables summarize the scores obtained by model overall and per each class.
  
  
  ### By Paragraph
  
  |                language                | precision |  recall  | f1-score |
  |:--------------------------------------:|:---------:|:--------:|:--------:|
  |             Achinese (ace)             |  1.000000 | 0.982143 | 0.990991 |
  |             Afrikaans (afr)            |  1.000000 | 1.000000 | 1.000000 |
  |         Alemannic German (als)         |  1.000000 | 0.946429 | 0.972477 |
  |              Amharic (amh)             |  1.000000 | 0.982143 | 0.990991 |
  |            Old English (ang)           |  0.981818 | 0.964286 | 0.972973 |
  |              Arabic (ara)              |  0.846154 | 0.982143 | 0.909091 |
  |             Aragonese (arg)            |  1.000000 | 1.000000 | 1.000000 |
  |          Egyptian Arabic (arz)         |  0.979592 | 0.857143 | 0.914286 |
  |             Assamese (asm)             |  0.981818 | 0.964286 | 0.972973 |
  |             Asturian (ast)             |  0.964912 | 0.982143 | 0.973451 |
  |               Avar (ava)               |  0.941176 | 0.905660 | 0.923077 |
  |              Aymara (aym)              |  0.964912 | 0.982143 | 0.973451 |
  |         South Azerbaijani (azb)        |  0.965517 | 1.000000 | 0.982456 |
  |            Azerbaijani (aze)           |  1.000000 | 1.000000 | 1.000000 |
  |              Bashkir (bak)             |  1.000000 | 0.978261 | 0.989011 |
  |             Bavarian (bar)             |  0.843750 | 0.964286 | 0.900000 |
  |           Central Bikol (bcl)          |  1.000000 | 0.982143 | 0.990991 |
  | Belarusian (Taraschkewiza) (be-tarask) |  1.000000 | 0.875000 | 0.933333 |
  |            Belarusian (bel)            |  0.870968 | 0.964286 | 0.915254 |
  |              Bengali (ben)             |  0.982143 | 0.982143 | 0.982143 |
  |             Bhojpuri (bho)             |  1.000000 | 0.928571 | 0.962963 |
  |              Banjar (bjn)              |  0.981132 | 0.945455 | 0.962963 |
  |              Tibetan (bod)             |  1.000000 | 0.982143 | 0.990991 |
  |              Bosnian (bos)             |  0.552632 | 0.375000 | 0.446809 |
  |            Bishnupriya (bpy)           |  1.000000 | 0.982143 | 0.990991 |
  |              Breton (bre)              |  1.000000 | 0.964286 | 0.981818 |
  |             Bulgarian (bul)            |  1.000000 | 0.964286 | 0.981818 |
  |              Buryat (bxr)              |  0.946429 | 0.946429 | 0.946429 |
  |              Catalan (cat)             |  0.982143 | 0.982143 | 0.982143 |
  |             Chavacano (cbk)            |  0.914894 | 0.767857 | 0.834951 |
  |             Min Dong (cdo)             |  1.000000 | 0.982143 | 0.990991 |
  |              Cebuano (ceb)             |  1.000000 | 1.000000 | 1.000000 |
  |               Czech (ces)              |  1.000000 | 1.000000 | 1.000000 |
  |              Chechen (che)             |  1.000000 | 1.000000 | 1.000000 |
  |             Cherokee (chr)             |  1.000000 | 0.963636 | 0.981481 |
  |              Chuvash (chv)             |  0.938776 | 0.958333 | 0.948454 |
  |          Central Kurdish (ckb