The binaries are all built with MKL, as you can verify by printing torch.__config__.show().
However, also be sure to check torch.__config__.parallel_info() as it could be that the number of threads is not properly set.