Hi,
I also get the same warning, while using AutoModelForMaskedLM on a fill-mask pipeline. Even though I finetuned it with AutoModelForMaskedLM…
Having randomly initialized layers should not be good for using the model. Is there any help to solve it?