I use the same hyper-parameters, same loss function, same model same initialization technique…
My dataset as you remember that it is quite imbalanced data.
For this reason, I use the Focal-Tversky loss(in my current experience it gives the best result).
However, if I use more number of GPU should I reduce the lower learning rate?
Could you teach me why I should reduce the learning rate?
Thank you for your answer.