Hi,
I’m trying to optimize the performance of distributed machine learning by assigning priorities for data packets. I’m wondering is there a way to get the dependency graph for computation/communication operations? In Tensorflow, we can extract the prerequisites for each tensor, but Pytorch seems to build the computation graph at the runtime and there’s no API to do so.