gordon was born 3 february 1811 the eldest son of sir william duff-gordon, a younger son of the house of aberdeen and his mother, caroline, who was a daughter of sir george cornewall. he succeeded to his father's title in 1823.