First, the Japanese government seized it. After Taiwan reverted to Chinese rule, it served for a time as the residence of Huang Kuo-shu, speaker of the Legislative Yuan. Several other residents came and left, and then it stood idle for a long period. In 1990, however, the Taipei Fine Arts Museum purchased it and turned it into a "center for artistic exchange."
先是被日本政府徵用，光復後一度做為立法院院長黃國書宅第，之後幾經流轉與閒置，直到一九九○年，再交由北美館成立「美術家聯誼中心」。