preferring to live in a stately home overlooking the falls that powered the family mill , they remained on reasonable terms with their brother , eldon waverley sanborn jr. , who resided at the family estate , known as waverley oaks .