Reformer inference widget is broken
From: https://huggingface.co/google/reformer-enwik8?text=My+name+is+Julien+and+I+like+to

![image](https://user-images.githubusercontent.com/1483922/117581699-17cede80-b0b3-11eb-8cb7-1bd790f2e8c2.png)

@patrickvonplaten
Yeah Reformer has no tokenizer so this doesn't work...sadly I also think since Reformer doesn't work super well, it's low priority to fix this (cc @Narsil )<|||||>Seems like the tokenizer fix is not that hard to make given the README (simply byte shift+2).

However the code seems to refer to a spiece.model : https://github.com/huggingface/transformers/blob/master/src/transformers/models/reformer/tokenization_reformer.py#L37

How bad is reformer performing ? (I am also curious to know how bad are character level models)

Edit: OK, this one is different because it is character level, but it's different from regular transformers that uses spiece, I see.<|||||>The character level Reformer  model does quite well at text generation

Here is a demo (from a while back) for generating Wikipedia like entries: 
https://colab.research.google.com/drive/1Oao8vBtDkz6v1E1efUhTlug5uuxC_BnE?usp=sharing<|||||>This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/master/CONTRIBUTING.md) are likely to be ignored.