Question: I'm using google chrome, is there some setting somewhere I can change?

Answer: 
Go to chrome://settings/handlers and remove the setting for gmail.
It is under Privacy then content settings.
It should respond to the windows defaults which are set in:-

> 
> control panel > internet options > programs > set programs
> 
> 
> 

This will set the mail client for all programs including chrome.