my-bigbird-tokenizer_son_v3 / added_tokens.json
FiratIsmailoglu's picture
Upload tokenizer
28e37bc verified
raw
history blame contribute delete
115 Bytes
{
"<pad>": 32002,
"[CLS]": 32003,
"[MASK]": 32004,
"[SEP]": 32001,
"bigbird_tokenizer_tr.vocab": 32000
}