He and his wife had six sons, five of whom fought in the First World War. Of these Patricius George died of wounds in 1915, Philip Mundy was killed in action in 1917 and Robert, weakened by poison gas, died of influenza in 1918. Between 1923 and 1938 the house was let to tenants, one of whom was Mrs D'Oyley Ransome. In 1938 it was sold by John Neville Chaworth-Musters along with its estate of 2,170 acres to the Crown, and was for a period the home of Major-General Sir Miles Graham and Lady Graham. It was during the Grahams' time that a visit was made by Bernard Montgomery, 1st Viscount Montgomery of Alamein on 21 August 1948. The hall gives its name to the "Wiverton Hall" ward of Rushcliffe Borough Council, as well as the group of Anglican parishes that surround it:  The population of Wiverton parish is included in the civil parish of Colston Bassett.