The manor house and the surrounding land at the river's mouth that is today downtown passed through several owners until 1813, when New York merchant Lemuel Wells bought the 320 acres around the manor house.