You could run a quick benchmark using this pseudo-code:
nb_iters = 100

# warmup
for _ in range(10):
    my_fun()

torch.cuda.synchronize()
t0 = time.time()
for _ in range(nb_iters):
    my_fun()
torch.cuda.synchronize()
t1 = time.time()
print((t1 - t0)/nb_iters)

where my_fun would be your current function(s) and the one(s) you would like to compare it with.