On his father's death in 1874, Nathaniel and his brother Ferdinand (1839–1898), owner of Waddesdon Manor, inherited most of the family's real estate and art collection. The family business went to the youngest brother Albert (1844–1911), who successfully carried on the financial empire.