To my best knowledge, it wont affect the result as long as the batch size distributed for each GPU is the same. Otherwise, you need to weighted average the loss. The precision should not be a big issue.