deep-metal / special_tokens_map.json

feature: first version of the model

bd0e5be over 4 years ago

181 Bytes

{"bos_token": "<|startoftext|>", "eos_token": "<|endoftext|>", "unk_token": {"content": "<|endoftext|>", "single_word": false, "lstrip": false, "rstrip": false, "normalized": true}}