parsig_tokenizer / added_tokens.json
Amin-Saeidi's picture
Upload tokenizer
1f49125
raw
history blame
86 Bytes
{
"</s>": 6882,
"<mask>": 6885,
"<pad>": 6884,
"<s>": 6881,
"<unk>": 6883
}