 He was the third and youngest son of Sir James Kennedy of Dunure, Ayrshire, and Princess Mary of Scotland, widow of the 1st Earl of Angus and second daughter of King Robert III of Scotland.His eldest brother was Gilbert Kennedy, 1st Lord Kennedy.James was born about 1408, and was sent to the continent to complete his studies in canon law and theology.