problem solved by using another optimizer, e.g. Adam optimizer.
The reason was I did not standardize  the target variable and it caused exploding gradients. The SGD Optimizer was not performing well in this problem.
and of course remove the last relu.