After restarting Pycharm and starting “fresh”
It returns:
Traceback (most recent call last):
  File "<input>", line 342, in <module>
  File "C:\Users\nero-\AppData\Local\Programs\Python\Python39\lib\site-packages\torch\nn\modules\module.py", line 727, in _call_impl
    result = self.forward(*input, **kwargs)
  File "<input>", line 223, in forward
  File "C:\Users\nero-\AppData\Local\Programs\Python\Python39\lib\site-packages\torch\nn\modules\module.py", line 727, in _call_impl
    result = self.forward(*input, **kwargs)
  File "<input>", line 200, in forward
RuntimeError: Tensor for 'out' is on CPU, Tensor for argument #1 'self' is on CPU, but expected them to be on GPU (while checking arguments for addmm)

Only if I have used the torch.set_default_tensor_type(‘torch.cuda.FloatTensor’) statement once in the session it returns the above comment of a few minutes ago.