Did you have any luck resolving this issue? I have exactly the same problem the model runs fine on my docker image on local. But if I try to run in google compute VM with a Tesla P4 I get
CUDA kernel failed : no kernel image is available for execution on the device

I tried specifying compute capabilities with
TORCH_CUDA_ARCH_LIST="6.0 6.1 7.0" python setup.py install

But still get the same error