Solved by ptrblck in post #2 
              
              
                If you are pushing tensors to a device or host, you have to reassign them: 
a = a.to(device='cuda')

nn.Modules push all parameters, buffers and submodules recursively and don’t need the assignment.