in 1863 he married margaret elliot pott (1842–1868), 22 years his junior. they had one son, herbert james gifford frse (born 1864) who became a civil engineer. margaret died aged 26 (probably in childbirth).