As part of the terms of sale he allowed Lady Holland to continue living in the house, as well as granting her an annuity for life of £6,000. The first Baron Holland's second son Charles James Fox was a Whig statesman. During his life, Holland House became a glittering social, literary and political centre, and the social centre of the Whig party, with his nephew, the third Baron, acting as host for his Whig dinners. Following his death in 1806, a statue of him was placed in the house's hall. Celebrated visitors to the house included the historian Thomas Babington Macaulay, the poets Lord Byron, Thomas Campbell, and Samuel Rogers, the politicians Richard "Conversation" Sharp and Benjamin Disraeli, and the writers Charles Greville, Charles Dickens and Sir Walter Scott. The political and historical writer John Allen was so much associated with the house that he was known as "Holland House Allen", and a room in the house was named after him. Lady Caroline Lamb, who had first met her lover Lord Byron at Holland House, satirised it in her 1816 novel "Glenarvon". The prestige of Holland House during the period extended to British colonies. In 1831 Henry John Boulton, who was born in Holland House, erected a baronial-like home in the city of Toronto. Henry John Boulton had been born in the famous English house, and he commemorated that fact by naming the Toronto home Holland House. When Henry Fox-Strangways inherited Holland House in 1874, he was living in Melbury House in Melbury Sampford, Dorset, where he owned large estates. It appears that the Earl was "in part motivated by the desire to preserve Holland House and its grounds from speculators", but had taken on financial burdens together with his inheritance which needed to be mitigated. He immediately made plans to develop part of the land to the west of Holland House, which became Melbury Road, named after his Dorset seat. Lady Holland, still living in Holland House, had objected and wrote that "all the building is a very bitter and sad pill to me". After her death in 1889, he moved into Holland House. Most of the already developed land had been let on long leases not expiring until 1904, after which he had scope to effect further development. Giles Fox-Strangways, 6th Earl of Ilchester inherited the house in 1905. During his ownership much of the land to its west was developed for housing as the Ilchester Estate, including Ilchester Place, completed in 1928, Abbotsbury Road (now forming the western boundary of Holland Park), named after Abbotsbury Abbey in Dorset, acquired in 1543 by Sir Giles Strangways at the Dissolution of the Monasteries, and several roads named after .