It depends on the local installation of various libs.
E.g. the binaries ship with CUDA, cudnn, mkl-dnn etc.
If you don’t have cudnn or mkl locally installed, you would see a slowdown.
However, you the latest versions of these libs might give you a speedup, so you could compare the binaries against your build from source.