He wasn't trying to get them ALL back, he knew they were hell bent toward important farming jobs in a distant land that they had just remembered. What he wanted was a few of them that would explain why they thought being a couple days normal travel from the Court was a good idea.