Hi Everyone,
So I am trying to run distributed data-parallel on single machine multiple GPU. I have consulted various tutorials from multiple resources and still facing issues.
I have asked multiple times here at various intervals of time, but no one seems to reply, is it some prohibited technology?
Last time, I asked this - Use Distributed Data Parallel correctly 6 and I have asked multiple times from various accounts too.
I am a beginner, if anyone could at least point me in general direction then it would help me a lot.
Thanks.
Edit: I have followed the below links -
https://pytorch.org/docs/master/notes/ddp.html#example 2
https://pytorch.org/docs/stable/distributed.html 2
https://github.com/yangkky/distributed_tutorial/blob/master/src/mnist-mixed.py 1
https://pytorch.org/tutorials/intermediate/ddp_tutorial.html 1
https://yangkky.github.io/2019/07/08/distributed-pytorch-tutorial.html 2