Depending how many different input shapes you have, the initial slowdown might be OK or is every input shape a new one?



 swpd:

By the way, which version of PyTorch is packed with cudnn8?


None so far, as we are currently creating PRs to enable cudnn8 in the source builds (cudnn8 isn’t released yet, just the RC  ).