The problem is, violence is the progenitor of all modern legitimacy. If you, Grug, can kill Grog, Grog's tribe is now Grug's tribe. Of course, we're way more civilized now, and as time goes on, the threat of personal violence becomes less and less effective. Legitimacy and violence are no longer connected.