I don’t see where you need pandas in your branch? For the tests, make sure that you pass all common tests as this is what will make sure your models work well with the library.
On the tokenizer side, pinging @thomwolf again as he may have some more insight. Or @lysandre maybe?