I have constant loss.
For example for adam optimiser with:
lr = 0.01 the loss is 25 in first batch and then constanst 0,06x  and gradients after 3 epochs . But 0 accuracy.
lr = 0.0001 the loss is 25 in first batch and then constant 0,1x and gradients after 3 epochs
lr = 0.00001 the loss is 1 in first batch and then after 6 epochs constant 
and gradients i dont know if thery are too small