While expanding the house leaves him mentally exhausted, the sphinxes and drow leave him physically exhausted through the night, ensuring the days go by quickly. He is, as always, free to bring along whomever he wishes, though this mission, theoretically, isn't going to be dangerous. Challenging, in a physical sense, but unlikely to be dangerous.