I want to reproduce some experiment results. However, many of them use 8 gpus and I only have 4 gpus or less. So how to change the lr、decay steps and total epochs？
For example, I use 4 gpus. Perhaps I should make new_learning_rate = learning_rate / 2，and the decay steps as well as total epochs should multiply by 2？？？？ I think it depend on how to realize the method of gradient descent， but I don’t know how to do it.