Yeah, so that’s what I implemented before that gave me the best speed up so far–except I went and wrote my own CUDA kernels. Something tells me unfold and fold are probably much more efficient than my im2col and col2im… ;-). I’ll throw this in and see what kind of speed it brings. Do unfold and fold leverage cudnn? That is, will torch.backends.cudnn.benchmark = True add anything?