Yes, measuring the whole model execution time. In my first post I thought the data transfer is slow, but it seems to be the model execution. I’m using the code from post 3. So yes, I’m having a sync before measuring t0 as follows (and the same for t1)
    torch.cuda.synchronize()
    t0 = time()