Hi…
Let’s start the talk by understanding your machinery.
What base OS do you have ?
Its a local machine or are you running in Cloud Computing ?
What version of Cuda, Cudnn, PyTorch, and Otther Libraries do you have?
How many Cores in CPU and What Model of GPU do you have ?
How many GPUs ?
How did you installed  each piece of Software ?
Pre-compiled or did you compiled yourself ?
If so what tutorials have you used or what scripts have you used to do so ?
Let’s start the debate from there.