And when a faction of them said , " O people of Yathrib , there is no stability for you [ here ] , so return [ home ] . " And a party of them asked permission of the Prophet , saying , " Indeed , our houses are unprotected , " while they were not exposed .