From the DDP Docs 5, you must do the following when initializing DDP:

For multi-device modules and CPU modules, device_ids must be None or an empty list, and input data for the forward pass must be placed on the correct device.

While you cannot specify which cores to run each process on from PyTorch, you should still be able to specify CPU affinity in general.