_:n0b48ec125f104157a2a652efd7248e4axb1
<http://schema.org/text>
"Hello,\n\nI am trying to implement Bert with multiple heads. However, im currently facing problem with loading BERT model and BertOnlyMLMHead separately to build a functional model.\n\nWhen I use the pre-implemented BertForMaskedLM model I get reasonable MASK predictions, when I use my own implementatio&hellip;"
<https://discuss.huggingface.co/t/how-to-use-automodel/5977>