@ojturner i tested it myself using the distilbert-base-uncased-finetuned-sst-2-english · Hugging Face 1 model with one time transformers=4.6.1 and one time transformers=4.12.3.
For me 4.12.3 is achieving better results than 4.6.1

4.6.1


Bildschirmfoto 2021-12-02 um 09.00.46972×568 63.7 KB


4.12.3


Bildschirmfoto 2021-12-02 um 09.03.081106×617 66.4 KB