This forum section is meant for the PyTorch distributed questions. It seems the code and error you are interested in is coming from Ray, so it would be best to ask on that forum (https://discuss.ray.io/)