hardy practiced plural marriage and was the father of 18 children. among his five wives were three sisters, sophia lois, esther smylinda, and harriet ann goodridge (name also shown as goodrich in some sources). his other two wives were elizabeth harriman nichols and rachel smith gardner.