I used torch.cuda.synchronize() to profile. My use case is simply convolving on a set of many many patches. unfold might do the trick actually. I’ve been looking through the docs, and correct me if I’m wrong, but isn’t this basically creating the “column” matrix from the im2col operation?
Once I get some stuff going, I will try to put together a proper profile still.