Thanks so much for your reply. I have one more question for you, as I’m now working on a Linux machine:
I have read through your tutorials for the parameter server and the DDP example. I have an application that just needs to share model parameters from a GPU process to a different CPU process. Which makes the most sense: a parameter-server type application using the remote calls, DDP, or sending tensors with recv/send?
Thanks again y’all.