 Following her death, he married Polly Sanford Olin and they had one child.Olin was the nephew of Gideon Olin, who also served as a United States Representative from Vermont.Gideon Olin's son, Judge Abram B. Olin, was Henry Olin's cousin.