 Martha died in 1828 after the birth of their fourth child.In the same year of Martha's death, Gause married a woman named Minerva, and they settled in Hancock, Massachusetts.Shortly after the birth of a daughter, Gause resigned from the Quakers on January 30, 1829, and joined the Shakers.