Solved by GirardR1006 in post #2 
              
              
                My mistake, I double checked my code today and I realized I used the .cpu() routine. According to the documentation at https://pytorch.org/docs/stable/tensors.html#torch.Tensor.cpu: 
Returns a copy of this object in CPU memory. If this object is already in CPU memory and on the correct device, then …