If you are not synchronizing the code, the next sync point will just accumulate the runtime.



 Hao_Hao_Tan:

it basically says that my GPU is not strong enough to compute all the results I need to transfer to CPU?


No, the result will be calculated and pushed to the CPU once it’s finished. Since the CUDA operation is executed asynchronously, the Python script executes the next line of code right after launching the CUDA kernel. Since the calculation on the GPU will take “some” time, the next line of code would wait, if it’s a sync point.