To get some more information about both workloads, I would recommend to profile them via e.g. Nsight Systems and check the timelines for both workloads. This would allow you to see any synchronizations and how how many kernels are executed etc.