you shouldn’t see such a difference on CUDA
conv_2 is faster for me (1.8.0a0 with OMP/MKL threading disabled). you may also see a different picture if you change 100000 -> 100
I’ve just seen a related PR: https://github.com/pytorch/pytorch/pull/48885 3

in general, performance & best approach may vary a lot depending on shapes