You could do this using torch rpc. Say your parameter servers follow some naming convention like “ps:##” and you know the total ps replicas. Then you could round robin or fall back to the surviving parameter servers if an rpc call fails.
How do you plan on keeping the data in the parameter servers replicated so that you are tolerant to ps failures?