Hi,
I think the issue is just when it’s a scalar:
In [1]: import torch

In [2]: a = torch.rand(10, requires_grad=True)

In [3]: a.requires_grad
Out[3]: True

In [4]: b = a.to("cuda")

In [5]: b.requires_grad
Out[5]: True

@smth is that expected behaviour?