Based on the description I think the server might be indeed rebooting e.g. due to an underpowered PSU if all GPUs are used. Once you are losing the ssh connection you could try to ping the server and should see a timeout until the node reboots.