albanD, thanks so much!
I tested the runtime on Tesla M40 before, and I used the Variable just because my code was written based on Pytorch 0.3.1.
Do you mean that the operation on Tensor instead of variable and maybe try other machine such as Titan Black can get the ‘real runtime’ (or just make the difference fairly small) ?
I do need to calculate the ‘real runtime’ to verify the validity of my algorithm.