The family moved to the western New York village of Palmyra in 1816–17, after an ill-fated business venture and three years of crop failures, and they eventually took a mortgage on a 100 acres farm in the nearby town of Manchester.