Haven’t used contiguous anywhere in the code. I’m using catalyst DL and segementation_models_pytorch. Catalyst DL uses contiguous call only in lovasz loss and I’m not using it.
Just checked cudnn.benchmark makes no difference.