Native transformers support via https://github.com/huggingface/transformers/pull/39228

Updates the tokenizer, configs, and removes the remote files - will update the readme accordingly as well

AntonV changed pull request status to open
liaojc changed pull request status to merged

Sign up or log in to comment