The house served as Richardville's primary residence until his death in 1841 and remained in the family until 1894, when it was acquired by a gravel company that mined all but approximately 1.0 acres of land surrounding the house.