 He was a trustee of Stanstead College and a director for several railway companies.Colby served as vice-president of the Quebec Temperance and Prohibitory League.Colby was the author of "Parliamentary government in Canada", published in Montreal in 1886.