 Ramsden married Juliet Ponsonby, daughter of Conservative politician Charles Ponsonby.Their youngest child was the artist Charlotte Cheverton, who died in a car accident in 1991.He died in March 2020 at the age of 96.