Hi,
It should be possible to shrink it as we do meet the pypi max package size. You can see in the release that our cuda binaries are around 700MB.
You might want to make sure that the cuda architecture detection works fine and only compile for the architecture that is relevant for you. You can use TORCH_CUDA_ARCH_LIST to force specific architectures. If it compiles for all of them, that will make the binary very large.
Also building with DEBUG=0 will avoid all debug symbols.
Do these help?