There is a warmup. That only happens once where the GPU is initialized.
Then what you see is the time to launch the job. Litterally the time to send the instruction to the GPU to perform a given operation. Because of hardware, this has a non-zero cost especially compared to executing something on the CPU itself.
The fact that the GPU is slower than the CPU for very small operation is completely expected.