Hmmm, I have not tested UNet in a distributed scenario, that’s the realm of real scientific studies 
Maybe reddit of comuper vision is a better place? Or try to ask a new question in the “comuter vision” block of the pytorch forum?