Hi,
Thank you for the reply. I am trying to code for multi gpus or gpu, cpu mix. I am sharing memory with this multi cores, so I am looking to get best standards. The requirement is more like using multi process and multi threads. For instance, if the graph is big I want to run the calculation is multi gpus or gpu, cpu mix to calculate it faster with multi threads. I saw an example implementation https://github.com/dmlc/dgl/blob/master/examples/pytorch/deepwalk/deepwalk.py 1
I am trying to follow the same idea, but i just want to make sure i do it right!!