in course of time , however , the impression seemed to have worn off , and about three months later he accompanied his father to the home of a gentleman in the neighborhood , for whom joseph w. occasionally did work .