Embedding and predictions in one forward pass
Is it possible to mix `BertModel` and `BertForMaskedLM`? i.e. is it possible to get the embedding and the predictions in one forward pass?
Yes, just make your own PyTorch model taking inspiration from BertModel and BertForMaskedLM.
If you sub-class `BertPreTrainedModel`, you'll be able to load the pretrained weights using the `from_pretrained()` method<|||||>Okay, thank you :) 