 He was initially engaged to Ludwika Karolina Radziwiłł but the marriage never materialized.On 25 March 1691 James Louis married Hedwig Elisabeth Amelia of Neuburg (1673–1722), the daughter of the Elector Palatine Philip William.They had five daughters, two of whom would have progeny.