I got the exact same problem for XLNet’s QuestionsAnsweringModel when I use the pretrained xlnet-base-cased model. It was working well probably 2 months ago and I didn’t change anything.
When I ignore this warning, the training loss will be too huge in each epoch.
I want to know is there a solution or reason now?