LLM / added_tokens.json
basit0513's picture
Upload tokenizer
1e91463 verified
{
"<pad>": 32000
}