Armsby married Lucy Atwood Harding of Millbury, Massachusetts, on October 15, 1878.[1] The couple had five sons: Charles Lewis, Ernest Harding, Sidney Prentiss, Henry Horton, and Edward McClellan, all of whom eventually graduated from Pennsylvania State University and several of whom became academicians themselves.[2]