Hi, I am new to the concept of DDP. I am currently training my model on two GPUs.


If I train on a single GPU with a batch size of b, do I need to divide this batch size by the number of GPUs available for training in DDP.


How can I calculate F1 score, Precision, Recall for a model being trained in DDP?


If I store local loss of two GPUs in two arrays. Is okay if I add them and divide by number of GPUs to get an average?