Well that’s okay.
Are you using the following scheme for gpu?
tensor = tensor.cuda()
convolution = convolution.cuda()
start-timing
convolution(tensor)
end timing

Note that you have to instantiate the class (in both cases) before starting to time