Avalon's the king's cousin so he's still directly linked to that bloodline too, technically. And Who says they have to be locals? He could be hiring mercs to fill in some of the blanks too.   And I'm pretty sure that there's always people who dislike the rule of a king no matter what kingdom you go to. Either out of political view or simply cuz they don't like the dude