chatglm3-6b / tokenizer_config.json

Commit History

revert "auto_map" in tokenizer_config.json (#41)
fa5a1b0
verified

Yuxuan Zhang jinmingyi commited on

對tokenizer增加special tokens使其能被.apply_chat_template正確轉換 (#36)
9addbe0
verified

Yuxuan Zhang p208p2002 commited on

增加對tokenizer.chat_template的支援 (#22)
1cfbbfd

Yuxuan Zhang p208p2002 commited on

Init commit
29f2cbe

duzx16 commited on

Implement new chat method
85ba2d2

duzx16 commited on