Baichuan2-7B-Base / tokenization_baichuan.py

Commit History

make sp_model init before __init__ to compat with transformer>=4.34
496a65a

ariwaranosai commited on

Initial commit
0b435f4

GuoPD commited on