Hi, can you try building against the latest master branch and see if the issues persist/paste the error logs?   A useful PR Revise the socket implementation of c10d by cbalioglu · Pull Request #68226 · pytorch/pytorch · GitHub 2 has just landed significantly improving the implementation and error logging of the c10d store so the logs should provide a lot more details in the case of errors.
In addition, since this seems like a reproducible bug, could you file an issue over at Issues · pytorch/pytorch · GitHub with reproduction instructions so we can take a deeper look?