Piper was a Scottish-born military officer of Cornish parentage, who arrived in the colony in 1792 and built a neo-Palladian mansion on the point, on 190 acres of land granted by the governor in 1816.