The land, a parcel of 100 acres known as Fanning Bank or Fanning's Bank, was in 1789 set aside by Lieutenant Governor Edmund Fanning as Crown land, with the specific stipulation that it be used as the site for the governor's residence.