Solved by ptrblck in post #2 
              
              
                Wrapping the operation into a no_grad() context would work: 
R = nn.Parameter(torch.randn(1, 1))
x = torch.randn(1, 1)

with torch.no_grad():
    z = x @ R
print(z.grad_fn)
> None