Let me get this correctly.
You recommend using torch.backends.cudnn.benchmark = True in any program where the dimensions of the input to the net doesn’t change over the batches.
By the way, what if I use PyTorch as “GPU Accelerated NumPy”, should I use this as well?
It would be great to a guideline how to use this feature.