Results of Fine-tuned model changes in every run
After I load the model with:
`
model = BertForNextSentencePrediction.from_pretrained("bert-base-uncased",state_dict=model_state_dict)
model.eval()
`
The prediction results are not stable. They change dractically in every run.

It gets stable if I fix the seed but I dont understand why we need that. Isnt the model supposed to be fixed since we are just evaluating?
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
