OSX keeps switching to the first space I use spaces with 10.9. I run a few applications in full screen mode. While focused on an application in full screen mode every minute or so I switched back to the first space. This happens with no input on my behalf. 

I suspected it was an application in the background taking focus. I shut down all applications that do this and have also disabled space switching on application focus. After a reset the issue persists. 

I noticed that the tool bar glitches out after the switch happens. It feels like a bug because when the application is not in full screen mode the icons on my desktop will disappear for a split second and then reappear. This seems to be happening with the same frequency as the space switching issue. Has anyone en-counted this? Is there a fix? It's driving me nuts!
This seems to be Google Drive-related. The behavior has stopped after quitting Google Drive app (in the taskbar).

If you have the same issue, please also report to the Google Support Forums so Google will know the extent of the issue: http://productforums.google.com/forum/#!category-topic/drive/report-a-problem/sv-ZC0ws3Mw

This is now fixed -
https://productforums.google.com/forum/#!category-topic/drive/report-a-problem/kqdqmoMWtk8