 He came to the site of what is now Port Hope with his family in 1797.His father and Jonathan Walton built a sawmill and gristmill there which formed the basis for the community that developed there.Smith was a merchant and miller and served as magistrate.