I tried your code now and it seems to work on my machine with different seeds.
For convergence I just set the number of epochs to 20000 and get the parameters:
Epoch 19999, params [Parameter containing:
tensor([[ 1.0000,  1.0000]]), Parameter containing:
tensor(1.00000e-05 *
       [ 2.9201])]