Riley-Smith was the eldest of four children born into a prosperous Yorkshire brewing family. His maternal grandfather (to whose memory he later dedicated his book What Were the Crusades?) was the British Conservative Party MP, John Craik-Henderson (1890-1971).[4]