DebertaForMaskedLM cannot load the parameters in the MLM head
Hello,
When I tried to use Deberta for MLM and I didn't succeed. It seems that it is a known issue.  The checkpoint provided by microsoft/deberta-base and other similar ones don't have the pre-trained weights of the Masked LM head.

https://github.com/huggingface/transformers/issues/15216

Thank you!
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/master/CONTRIBUTING.md) are likely to be ignored.