 In 1902, Anson Phelps Stokes, a New York merchant, banker and philanthropist, bought the southern tip of Long Neck and built "Brick House" where he and his family lived for "many years," according to Henry Case and Simon Cooper.