I see.
Well the MSELoss can be quite large due to its nature, but this is still very high… It also depends on the nature of your problem (so your X and y values).
Also, does it start at the same values in the first epoch? This might indicate that your network is not learning anything.