Thanks for your reply.
The server have 1 x intel core i7-6900k cpu,4 x NVIDIA GTX 1080 and a power supply unit of 1600W rated power.
Is the power supply sufficient? And how much speedup will I get if I set cudnn.benchmark=True?