Neural Networks, Machine Learning, Deep Learning, Computer Vision, Data Science.
learning rate is a hyperparameter. A hyperparameter has its value determined by experiments. We try different values and use the value that gives best results. There are some ways that just helps you select values of hyperparameters. Testing Network For our problem, I deduced that a value of .00001