 Rabun was a devout Baptist and a self-educated man.Rabun was a member of both houses of the Georgia General Assembly.In 1805, he was elected to the Georgia House of Representatives, and in 1810, he was elected to the Georgia senate, serving until 1817 as president of the senate.