sure,I compared different versions of pytorch ,cuda and cudnn,the results are:
pytorch1.7.0, cuda11.0, cudnn 8.0.3
without apex: [112it/s]
with apex :[82it/s]
pytorch1.7.0, cuda10.2, cudnn 7.6.5
without apex: [110it/s]
with apex :[82it/s]
pytorch1.3.1, cuda10.0.1, cudnn 7.6.5
without apex: [147it/s]
with apex:[116it/s]
pytorch1.4.0, cuda10.0.1, cudnn 7.6.3
without apex: [141it/s]
with apex: [113it/s]
I’m not a English speaker so I don’t quite get what does “regression” mean, But in my point of view,  the version of pytorch makes a big difference in performance, I hope you can help me to figure it out