After remarrying, he bought the 23 acres to the north for $150,000 ($ in modern dollarsUS) and commissioned Charles W. Clinton, an architect with offices near his in what is today Lower Manhattan, to design a house.