Thanks it worked. Now my loss are not converging, all over the place!
Tried setting lr and momentum as little as 0.000001, 0.00009 from default: 0.01, 0.9, no avail.
Because of it predicted values are all 0.
I am using housing data with two layers:
linear(8, 30)
linear(30, 1)
with mseloss.