Once a 15 meters high or higher sandstone islet, the rock was levelled by convicts under the command of Captain George Barney, the civil engineer for the colony, who quarried it for sandstone to construct nearby Circular Quay.