Hi,
Now I am using keras with a simplified interface of data parallisim sync version of parallelism.
Now I wish to know if pytorch has similar function, seems like PyTorch is trying to advocate in “Speed”, so it had better support Multi-GPU just for a single node.
Thanks,
Shawn