I don't see why that's a problem, the can always just be sleeping cause of hangovers, or maybe they winded up somewhere else and are just now getting home, I mean who knows what that goblin could be up to?