colquitt was married twice: first to the former dorothy elizabeth tarver (1829-1855), and after her death to her brother's widow, the former sarah bunn tarver (1832-1898). he was the father of three children with his first wife and seven children with his second wife.