Those that didn't vote for him outnumber those that didn't by a pretty wide margin. It's hard to govern like a maniacal tyrant in a democracy. Especially in a two party system where you don't have the support of the electorate.