Here is a nice post from a Nividia forum that might help explain it better than what I did
https://devtalk.nvidia.com/default/topic/953975/sequential-code-is-faster-than-parallel-how-is-it-possible-/ 36