gough was married four times; first to dinan graves they divorced. second to anne leon in 1950 through 1964. third to anneke wills in 1962 until they divorced in 1979. lastly to henrietta lawrence in 1980 until his death in 2011. gough had 3 children; emma, simon, and jasper.