As a child, Hou's grandmother used to pamper him, after a fortune teller told her grandson would become a high official.
「他為人正直、立場清楚，卻又不失厚道。」歌星蔡琴形容他是個溫柔多情的人。由於侯孝賢常在外拍戲，少有時間和兒女相處，於是在其他方面表現他的關愛：他知道女兒喜歡搜集郵票，外出拍戲時，只要看到漂亮的都會買下或小心剪下妥為保存，好帶回去給她。