 He left the school in 1833, and married Rebecca S. Leach on February 11, 1834.He was ordained a minister in the Presbyterian Church in 1837, and served as the pastor of the Presbyterian Church of New Rochelle, New York from 1837 through 1841.Beginning in 1841, he served with the literary department of the American Tract Society, a position he kept until 1843, when he went to New York City to found a new girls' school.