"or to go out to perform a mitzvah if the time does not suit him" meaning if the time doesn't suit him in all aspects to go out and perform a mitzva, if he has a small difficulty or he needs to exert himself a bit- it's not for him.