cavendish was born in douglas, isle of man, the son of david cavendish also from the isle of man, and adele from yorkshire. he began riding bmx at a young age, racing at the national sports centre in douglas. it was at that time that cavendish met david millar at a race on the isle of man. cavendish said he was inspired by millar.