Based on this comment 2 it seems that the latest NCCL release (2.10.3) is supporting WSL2 partially, but I don’t think that a native Windows NCCL version exits, so you might need to check other distributed backends.