In the show most earth ponies are farmers or bakers stuff like that something that requires contact with their work but it's pretty obvious that they still have magic, just not a horn. But that still doesn't explain why unicorns have more magic than other ponies. My best guess is that unicorns simply use their magic to make a direct effect more often than the other types of ponies.