NeoBERT / tokenizer_config.json

Commit History

Specify that we don't want the token_type_ids from the tokenizer
05bfcea

Tom Aarsen commited on

Upload tokenizer
f9eb7ee
verified

Lolalb commited on