I am using pytorch doc: https://pytorch.org/tutorials/beginner/blitz/cifar10_tutorial.html#training-an-image-classifier 4 with and without torch.backends.cudnn.benchmark and with
export CUDNN_LOGINFO_DBG=1
export CUDNN_LOGDEST_DBG=log.txt