Is the slowdown only happening on scripted models or any GPU workload?



 michele-arrival:

Btw is there any way to check that pytorch is loading the correct cuda libraries?


You could check the used CUDA version via torch.version.cuda and depending on the way you’ve installed it (binaries or source build) it can be either statically or dynamically linked.