Thanks for the reply! I’ve tried with a smaller learning rate and it did work! Plus, with smaller learning rate the performance (judged by the loss curve) is even better. I don’t yet understand the reason though, as it is not like a problem of overfitting …