Roberta Large not working with SNLI dataset always gives random baseline that is 33 percent accuracy.
I have been working with parts of SNLI dataset, even after hours and hours of pretraining the model always gives 33.24 percent accuracy no matter the amount of the data used in pretraining. This issue is fixed if I revert my transformers version to 2.11.0 
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
