@YuxiaoXu if you kept these particular env variables intact: https://github.com/pytorch/builder/blob/master/manywheel/build.sh#L27-L39 73 then there’s no reason it will take 3 minutes startup time in 2nd machine.
The only situation I can think of, where that will happen is this:

You build wheel with CUDA 8
2nd machine has Volta GPU

In this case, it will runtime-compile some CUDA kernels for Volta (because Volta needs atleast CUDA9 for direct support)