I am reading many posts about Learning rate. Most of them are saying to keep it in between 0.1 to 0.001. I have a dataset of 1000 images of 4 classes. Can anyone please tell me, that what should be my proper learning rate. I have fixed it to 0.003 and pretty much giving me results with starting from 50-53% to max 78% to ending with 68%. Can anybody tell, if it is right or should I optimize more? I have tried smaller rate, but giving me also same results. Thanks.