Add pad token to tokenizer

by sanchit-gandhi - opened Nov 3, 2022

←

Nov 3, 2022

Whisper large is missing the pad token, which is otherwise added in the tiny-medium models (e.g. https://huggingface.co/openai/whisper-medium/blob/main/special_tokens_map.json#L125). This PR adds the pad token for the large checkpoint.

Nov 3, 2022

Thanks

ArthurZ changed pull request status to merged Nov 3, 2022

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment