Not sure what could be the issue but when I do torch.cuda.device_count() inside a Python REPL it says 4, but from inside a Jupyter notebook it only reports 1. I’m running this on an Amazon EC2 instance (p3.16xlarge).