Using pytotch 1.5, setting CUDA_VISIBLE_DEVICES appropriately per process, doing any CUDA related stuff before the ENV var is set and changing the DDP constructor with:
device_ids=[0],   # set w/cuda environ var
output_device=0,  # set w/cuda environ var

it seems to be working as expected: