I don’t think the “single accelerator” means it’s usable as a single device, but as an accelerated system due to the better interconnectivity.



 mohotmoz:

I guess I’m just wondering if that is possible for DL workloads with PyTorch…? Sounds like no?


Yes, you can use NVLink/NVSwitch through DistributedDataParallel or any other parallel approach.