His paternal grandfather Chang Shu-ping passed the imperial civil service examination, and his elders in his father's and his own generation became connoisseurs of art and antiques. His maternal grandfather was a scholar from Shekou in Fengyuan and an even more avid collector. Scholars and literati visiting from Japan, mainland China, Britain, and America would make special trips to visit him, and were always received warmly.
由於家境富裕，祖父張書炳又為前清秀才，張允中的父執輩與兄長都喜歡賞翫古物，住在豐原社口的外祖父更是收藏名家，當時遠從日本、中國大陸或英美各國來台的文人雅士，都會專程前來，也都受到熱情款待。