This is with reference to previous question.
I am trying to train the entire netork which consists of two modules with their own classifiers and I observed that both of them have their own convergence speed. Moreover they also need different learning rates because I tried with different possible combinations still the loss of only first module is decreasing but not the other. I wanted to know how will I find common learning rate in such case? Is there any existing way to do so?