Commit History

Rename tokenizer/tokenizer_special_tokens_map.json to tokenizer/special_tokens_map.json
6c0a65f
verified

pt-sk commited on

Rename tokenizer/tokenizer_merges.txt to tokenizer/merges.txt
4e4961b
verified

pt-sk commited on

Delete tokenizer/a.py
7cd23ce
verified

pt-sk commited on

Upload 4 files
6f4fcb8
verified

pt-sk commited on

Create tokenizer/a.py
efc0580
verified

pt-sk commited on