In Keras I tried also vanilla SGD and seam to work … so I suppose the difference is made  also just from network architecture … I do not know if can be size of the parameters or layers sequence…types of layer seam are the same.