I was aware of the difference but not sure what was difference that would make one work over the other. I thought the default learning rate of 0.01 would have made it learn at least something, that was also the defaut of SGD that worked also for Keras. Thanks for your suggestion.