Could you post a small executable code snippet so that we could have a look at it?
If you are timing your code, note that CUDA calls are asynchronous so that you would have to synchronize before starting and stopping the timer.