Models

naclbit/gpt-j-japanese-6.8b

Text Generation • Updated Nov 10, 2021 • 26 • 28

IDEA-CCNL/Randeng-T5-77M

Text Generation • Updated May 26, 2023 • 145 • 4

IDEA-CCNL/Randeng-T5-784M

Text Generation • Updated May 26, 2023 • 102 • 10

IDEA-CCNL/Randeng-T5-784M-MultiTask-Chinese

Text Generation • 0.8B • Updated May 25, 2023 • 427 • 75

IDEA-CCNL/Randeng-T5-77M-MultiTask-Chinese

Text Generation • 0.1B • Updated May 25, 2023 • 120 • 26

IDEA-CCNL/Randeng-T5-Char-57M-Chinese

Text Generation • Updated May 26, 2023 • 41

mkshing/novelai-tokenizer-v1

Updated Aug 14, 2023

NovelAI/nerdstash-tokenizer-v1

Updated Aug 2, 2023 • 7

NovelAI/nerdstash-tokenizer-v2

Updated Aug 2, 2023 • 8

if001/sentencepiece_ja

Updated Jan 23, 2024 • 2

shantipriya/OdiaTokenizer

Updated Nov 10, 2024 • 13 • 1

metinovadilet/kyrgyz_t5_tokenizer

Updated Feb 24

Namuun123/mn_sentencepiece_tokenizer

Updated Apr 25

Hanbaike/kyrgyz_bpe_16000

Updated May 8

Hanbaike/kyrgyz_bpe_24000

Updated May 8

Hanbaike/kyrgyz_bpe_32000

Updated May 8

Hanbaike/kyrgyz_bpe_4000

Updated May 8

Hanbaike/kyrgyz_bpe_51200

Updated May 8

Hanbaike/kyrgyz_bpe_8000

Updated May 8

Hanbaike/kyrgyz_unigram_16000

Updated May 8

Hanbaike/kyrgyz_unigram_24000

Updated May 8

Hanbaike/kyrgyz_unigram_32000

Updated May 8

Hanbaike/kyrgyz_unigram_4000

Updated May 8

Hanbaike/kyrgyz_unigram_51200

Updated May 8

Hanbaike/kyrgyz_unigram_8000

Updated May 8

Hanbaike/kyrgyz_spm_tokenizer

Updated May 8

mrcha033/YunMin-tokenizer-96k

Text Generation • Updated May 28 • 18

LocalDoc/az-en-unigram-tokenizer-50k

Updated May 30 • 1

Vipplav/telugu-bpe-23k

Updated 20 days ago