in 1686, the king granted the mayor and city council permission to sell the building to a member of the donators' family to raise money for the school. in 1598, it was sold to peder brahe, whose wife, margrethe gøye, was a niece of birgitte gøye. they expanded the house with the west wing on sankt anna gade in 1592. the city acquired the brahe house as it was then known in 1630 and turned it into its new poorhouse. in 1632, the old hospital building was expanded to the same height as trolle's house. the poorhouse was later expanded with a half-timbered north and west wing, turning it into a four-winged complex with a central courtyard. in 1761, 71 people lived in the building and by 1845 the number had increased to 96. the south wing as from 1805 until 1841 used as a school for the poor with up to 120 pupils. the poorhouse was decommissioned in 1902. helsingør city museum took over the building in 1973. it had previously been based in marienlyst castle.