NCCL does not require NV{Link,Switch} but also works with PCIe. If you don’t have it properly installed Multi-GPU performance will likely be poor.
Can you please post the error that you got during compilation?
If you are compiling from source, did you update the submodules (e.g. because you are building a specific PyTorch release)?