You should normalize the target value of regression, or I think it will be very hard to train this network. For regression, you could do something like log or, if you know the bounds, just normalize it to 0 to 1.
Yes, because the net.parameters() will return all the paramters of the network so all the parameters will be optimized.
It’s good to pick a topic of this thread : )