Solved by LeviViana in post #4 
              
              
                Alright I got it ! 
BTW, there was a mistake is the previous snippet -> I forgot to synchronize the kernels  
Here is the correct snippet (PS: I removed the t2 since it throws an error): 
import timeit

setup = """

import torch
import torch.nn.functional as F

device = "cuda"

x = torch.rand(200, 3…