By 1710 the castle was in such a bad state of repair that Richard, the 5th Viscount Fitzwilliam, selected 100 acres (0.4 km²) on which he built Mount Merrion House, surrounding the house by an 8 feet granite wall.