It is not said how long the Prince stayed with the Giant , but one day the latter came to him and said he would now take him over to the mainland out of the island , for he himself had no long time to live .