I’m using PytorchLightning which takes care of most of the configuration code.
I know that is usual to just log rank0 outputs but I want to log one audio per speaker or specific audios in the dev set. Hence, I need to save audios processed on different GPUs.
I thought that workers sync’ing was for example to combine all models losses (one per GPU) and run backpropagation on the total amount.
I will check how to synchronize the logger.