 He married again, in 1867, Frances Davenport, daughter of William L. and Loretta Cole Wadhams of Wadhams Mills, New York.He was a Freemason, and a longtime comrade of C. J. Ormsbee Post #18, Grand Army of the Republic, named for his brother, Charles James Ormsbee, 5th Vermont Infantry, who was killed in action at the Battle of the Wilderness on May 5, 1864.Ormsbee was president of the Brandon Free Public Library, president of the Brandon Cemetery Association, member of the prudential committee of the Brandon graded and high school for over 27 years, and president of the Brandon National Bank for more than 14 years.