Hello!
I need to fast converge a neural network in a limited number of epochs. Image classification: CNN
What I discovered:

The network should be shallow.
Learning rate balance is needed to converge fast.

Could you give me the fastest converging optimizer and recommendation for learning rate and activation function in the last layer to finish what I need?
Great thank you!