No, I didn’t double the batch size.
But since each GPU takes half of the batch at each iteration, each iteration should be faster and since the number of the iterations remains the same the whole process should be faster.