Thank you all,
I have a working POC here:
https://github.com/QuantScientist/Data-Science-PyCUDA-GPU/blob/master/day%2002%20PyTORCH%20and%20PyCUDA/PyTorch/09%2BPyTorch%2BKaggle%2BImage%2BData-set%2Bloading%2Bwith%2BCNN.ipynb 3.1k