In On the Wealth of Nations, Adam Smith says that the rich should pay more in taxes, since the rich can afford it better. 

The underlying premise of your post can be traced back to Caine's question in Genesis, "Am I my brother's keeper?" It would appear that you would answer "No."