Your screenshots are a bit hard to decipher, however based on some values I could read it seems that the CUDA operations are using approx. the same amount of time, while CPU ops are a bit slower.
This could point towards a CPU-bound workload and the host might not be fast enough to run ahead and schedule the GPU work fast enough if you start multiple processes.