during the 1949–50 tour of south africa, harvey met his first wife iris greenish. at the time, greenish was only 16 years old and harvey 21, and their relationship became the subject of controversy when her father told the media that he would object to the couple's engagement until his daughter turned 18. they married four years later at holy trinity church in east melbourne and had three children, two sons and a daughter.