Top Up!
I really need to improve the inference performance on CPU. After I found the benckmark of mkldnn, I want to have a try. However, compiling pytorch with mkldnn seems not native, because I have to struggle with variables like NO_MKLDNN,  WITH_MKLDNN, MKLDNN_* …  I wish compiling pytorch with mkldnn will be much easier, just as easy as linking mkl or openblas.