Hi,
The binary comes with a set of bundled libraries (mkl, magma, etc) that are very important for speed.
If you compile from source, you will want to make sure you have the relevant ones for your workload installed locally so that they can be used during compilation.
Also in some cases, build of openBLAS, magma, etc tailored to your machine will be slightly faster.
But if you don’t have any blas library (or use the system default one) you might see lower performance compared to the binary code that has an off the shelf optimized blas for example.