(Maybe just have them disappear in the chaos of the invaison? Leave their fate nebulous so if he comes back the characters are fine to come back (que dramatic plot of Veron attempting to retake his empire?) but if he doesn't they're not in the way).