BEIT masked lm
How can one generate labels for BEIT masked LM? 
Hi,

I've created a Colab notebook to illustrate `BeitForMaskedImageModeling` [here](https://github.com/NielsRogge/Transformers-Tutorials/blob/master/BEiT/Understanding_BeitForMaskedImageModeling.ipynb).<|||||>See also this issue: https://github.com/microsoft/unilm/issues/401<|||||>Thanks!<|||||>Hi @NielsRogge,

did you have any progress in reconstructing the masked visual tokens with BEiT so that they correspond to the ground truth labels? I am having the same issue.

Thanks<|||||>Hi,

I'm pretty sure my implementation is correct. You can visualize the predictions of BeitForMaskedImageModeling using DALL-E's decoder.