No, in case of one process per each  gpu NCCL error  doesn’t reproduce. But another problem arises: all processes freeze during DistributedDataParallel initialization.
model = DistributedDataParallel(
    model,
    device_ids=[device],
    output_device=device,
)