Solved by ptrblck in post #2 
              
              
                The difference between the code snippets seems to be the sequential vs. parallel execution. 
Each CUDA operation will launch a kernel, which will create some overhead. 
This overhead of the kernel launch is often not visible, if the actual workload on the GPU is large. 
However, in your first exampl…