ph0123:

I use 32 CPUs on this machine. (All of my CPU on the machine.)


In this case, the new TensorPipe (coming in v1.6) RPC backend might be useful, as it provides a shm channel to send RPC data. Will keep you posted on that.