Its original architecture is some 76 years old, and it was used as a residence for high-ranking officials during the Japanese occupation. After 1949, Wistaria House became the residence of Chou Te-wei, then head of the Customs Affairs Administration under the government's Ministry of Finance. Due to typhoon damage caused in 1961, the Chou family turned the outer half of the residence into a two-story Western-style building.
它的原建築物距今至少有七十六年歷史，在日據時期原是簡任官宿舍，光復後成為當時財政部關務署署長周德偉的宿舍，民國五十年因為颱風造成損壞，周家把宿舍的外半部改建成兩層洋樓。