Hi,
This is expected for small operations.
The cost of launching the work on the gpu is actually more than what is spent actually doing computations.
Try increasing your tensor size and you will see that the GPU version doesn’t get much slower while the cpu one get slower very quickly.