 Ricketts was married twice, first to Harriet Pierce, in 1840, daughter of Benjamin Kendrick Pierce (brother of future U.S. President Franklin Pierce) and Josette Laframboise.They had one child, a daughter Mary Brewerton Ricketts, born in 1842.After Harriet's death in 1854, he married Frances "Fannie" Lawrence.