GPT Neo configuration needs to be set to use GPT2 tokenizer
The tokenizer wasn't correctly set and ended up making ~200 slow tests fail. The run in question is here: https://github.com/huggingface/transformers/runs/2232656252?check_suite_focus=true

This PR fixes that!