 Early buildings were damaged or destroyed during the Japanese invasions of Korea (1592–1598), but some of the early construction remains.Under the direction of Queen Mother Jo, Unhyeongung was converted into a grander complex with four gates.Although the residential complex was taken from the Heungseon Daewongun's descendants under Japanese colonial rule, it was returned in 1948, and in 1993 they sold it to the Seoul government.