Thank you for your reply. You’re right about the gradient descent. I will try to use the optim to see the difference.
I agree also with you about the model. Related to the training test I choose yes we can use a simpler model but from what I read the linear/relu/linear is a kind of all purpose model. Is it correct?