@simonw but there should be double backward for ConvT both in test1 and test2, and only test2 is painfully slow.
@ptrblck can you get nvvp for it and may be run it through pyprof, though I suspect pyprof will choke on double backward.