Thanks @ptrblck for your kind reply
I will experiment with the code block that you have shared and see the difference if lr was also small like 0.0005 vesus a large lr of 0.002
I guess that lr might start with larger value and then settle into the max value set by max_lr
What could be the advantages of such a setting ? (or any draw backs too of such setting)