Timing without synchronization might give you wrong answered and you mentioned you are already synchronizing the code.
That being said, you need to initialize the CUDA context  in your first CUDA operation, which cannot be avoided.