update tokenizer for compatibility with new transformers

#64

padding_side added to _pad method signature in transformers 4.45

without that, we got TypeError: ChatGLMTokenizer._pad() got an unexpected keyword argument 'padding_side'

@zRzRzRzRzRzRzR could you please ake a look on one more PR for compatibility with new transformers?

Greetings, model owners!

Can anyone merge this PR to make the model tokenizer compatible with the latest version of Transformers library as well?

Thank you!

Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment