During his stay in Atlantic City, Baker inclined increasingly towards Episcopalianism and converted to the Episcopalian church, becoming a Deacon and then, in 1879, an ordained priest. He worked both as an assistant rector and rector of several churches in Pennsylvania, including, as assistant to the rectors of St. George's Church, Philadelphia[3] and the Church of The Epiphany.