Thanks for the reply.
Actually, I train both of them using 5r-4(0-80k), 5e-5(80k-100k), 5e-6(100k-120k) so the optimisation steps should be the same for both of them?
Or do you mean I should add more steps for 3GPUs’ training?