Hi,
I am trying to training a SSD(vgg based) for facial detection.
Then I just find out a problem:
When I train the model on a single GPU with batch size = 4, I get a better result than train on 3 GPUs with batch size = 6.
The learning rate settings and the training iterations are exactly the same in both training.
However, I expected that the 3GPU’s should get a better result because of a larger batch size.
Can someone help me to find out the reason?