@smth @zym1010 excuse me. I am facing the same problem these days so I hope you can help me.  Since I am working on an offline machine with ubuntu16.04, I can’t directly use the builder script in the reposity smth offered.  Instead, I write a new one according to https://github.com/pytorch/builder/blob/master/manywheel/build.sh 65. In this script, the enviroment variables and the deps list maintains the same.
The problem is, using this script, I can obtain a .whl file and can install it in another machine (with cuda installed). However, I find that it will take a long time (about 3 minutes) in the procedure “lambda t: t.to_cuda()” when call module.apply().  I guess that the reason may be the cuda dependencies has not been fully integerated in the whl file. Could you please tell the reason, or share the correct process to build a “manywheel” file?