The house became the property of the British military in 1814 and was selected as the seat of the island legislature in 1872 , when the capital was moved from Spanish Town to Kingston .
There was a lot of anger over the British taking of the house .