Try to remove the last activation function and use the output of the last linear layer as the prediction (if that’s not already the case).
If that doesn’t work, try to play around with more hyperparamters, such as the learning rate etc.