The imposing building on the 2 hectares site overlooks the harbour city and was the largest public building constructed by convicts in the State after the Fremantle Goal which had been built in the 1850s.