Robert FitzRoy
Robert FitzRoy was born at Ampton Hall, Ampton, Suffolk, England, into the upper echelons of the British aristocracy and a tradition of public service. Through his father, General Lord Charles FitzRoy, Robert was a fourth great-grandson of Charles II of England; his paternal grandfather was Augustus Henry FitzRoy, 3rd Duke of Grafton. His mother, Lady Frances Stewart, was the daughter of the first Marquess of Londonderry and the half-sister of Viscount Castlereagh, who became Foreign Secretary. From the age of four, Robert FitzRoy lived with his family at Wakefield Lodge, their Palladian mansion in Northamptonshire.
Charles Augustus FitzRoy
Sir Charles Augustus FitzRoy married, firstly, Lady Mary Lennox (15 August 1790 – 7 December 1847), first-born child of Charles Lennox, 4th Duke of Richmond, on 11 March 1820. They had 4 children:Lady Mary died from a carriage accident in Parramatta Park, outside Government House, in 1847. Within a year of her death, rumours were circulated about the colony of New South Wales about FitzRoy's 'womanising' ways. In 1850, FitzRoy made a visit to Berrima, to inspect the Fitzroy IronWorks. The Governor stayed at the Surveyor General's Inn, operated by former boxing champion Edward "Ned" Chalker (sometimes Charker). Ned's step-daughter, Mary Ann Chalker, who was 18 at the time, worked there. Nine months later, she gave birth to a son, named Charles Augustus FitzRoy, after his father, the Governor. This boy was later adopted by ex-convict John Fitzsimons and his family.Sir Charles Augustus FitzRoy married, secondly (after his return to England), Margaret Gordon, on 11 December 1855. There was no issue from this marriage.