In 1887, they built the 20000 sqft corporate vacation home Villa Maria Water Mill, Long Island, where the two families could relax for the summer, but Ayres' wife Louise died in September and never got to enjoy it.