Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
shantipriya
/
OdiaTokenizer
like
1
OdiaGenAIdata/pre_train_odia_data_processed
Oriya
sentencepiece
License:
cc-by-nc-sa-4.0
Model card
Files
Files and versions
Community
main
OdiaTokenizer
Ctrl+K
Ctrl+K
1 contributor
History:
7 commits
shantipriya
Create tokenizer_config.json
ca15fcc
verified
7 months ago
.gitattributes
Safe
1.52 kB
initial commit
7 months ago
README.md
Safe
3.42 kB
Update README.md
7 months ago
config.json
Safe
248 Bytes
Create config.json
7 months ago
odia_tokenizers_test.model
Safe
1.37 MB
LFS
Add SentencePiece tokenizer model for Odia
7 months ago
odia_tokenizers_test.vocab
Safe
1.3 MB
Add SentencePiece tokenizer model for Odia
7 months ago
tokenizer_config.json
Safe
245 Bytes
Create tokenizer_config.json
7 months ago
