Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
bigcode
/
tokenizer-the-stack-march-sample-v3
like
0
Follow
BigCode
1.47k
Model card
Files
Files and versions
Community
main
tokenizer-the-stack-march-sample-v3
Ctrl+K
Ctrl+K
3 contributors
History:
3 commits
RaymondLi
fix pretokenizer
339010c
over 2 years ago
.gitattributes
Safe
1.48 kB
initial commit
over 2 years ago
merges.txt
Safe
443 kB
Upload tokenizer
over 2 years ago
special_tokens_map.json
Safe
532 Bytes
Upload tokenizer
over 2 years ago
tokenizer.json
2.06 MB
fix pretokenizer
over 2 years ago
tokenizer_config.json
Safe
677 Bytes
Upload tokenizer
over 2 years ago
vocab.json
Safe
778 kB
Upload tokenizer
over 2 years ago
