Following these criticisms, the fort was finally demolished in 1873.[13] The fort gave way to the first General Post Office and the Exchange Building in 1874.[5] Plans to erect Fullerton Building were drawn up in 1920.