Shisho_Sama:

by MLDNN being 10% slower do you mean slower than the gpu implementation or the normal cpu?


I meant the cpu 



 Shisho_Sama:

I simply used the pip package and installed the cpu only version as I dont have a supported GPU on my system.


Why don’t you use conda ? For instance, when I run conda list | grep mkl I get:
mkl                       2019.3                      199  
mkl-include               2019.4                      243

These packages are used when you compile torch from source in order to enable mkl-dnn. I’m not sure, but maybe you should have these installed to download the binary having mkl-dnn enabled.