Are you running on 4 GPUs on 32 compute nodes resulting in a world_size of 128? If so what is the --workers=23 argument referring to?
To debug this, can you look at all other ranks to see what they are doing? For example, you should see logs like Added key: xxx to store for rank: yyy" This would help in debugging why certain ranks might not have written to the store.
Based on the error you shared above, it looks like only 43/128 ranks reported in.