dictionary / added_tokens.json
nroggendorff's picture
Upload tokenizer
e26184e verified
raw
history blame
74 Bytes
{
"[CLS]": 4,
"[MASK]": 5,
"[PAD]": 3,
"[SEP]": 2,
"[UNK]": 1
}