Changing Adam’s learning rate didn’t do it. I think Adam is too “strong” for this problem. I got better results with SGD(lr=0.1) and a larger batch size, but the model converges very slowly. Maybe it is a problem with the data…