Her carriage was accompanied with a band on her way to Scarisbrick Hall. Ann, unlike her brother, lived in much splendour at Scarisbrick Hall. During her occupation, the hall was gas-lit for the first time. The central heating system seems to have been installed and used during her period of occupation. Ann was popular as a society hostess and held many gala events at her residence and estate. Even though Ann, under the terms of her brother's will, had only inherited Scarisbrick Hall and not its furnishings she set out to redecorate and redesign the house on a much grander scale than had prevailed in the time of her predecessor. The renovations were carried out by Edward W. Pugin, the son of the architect Augustus Pugin who had created the designs of the hall during the time of Charles Scarisbrick. Ann allowed the younger Pugin greater scope than had been afforded to his father. It was during this time that the older clock tower, dating from the time of Charles Scarisbrick, was replaced with a grander and taller example built in the French Gothic style. A new East Wing was added, which Ann dedicated it to the memory of her father. This wing was joined to the older building by an octagonal tower which was decorated with eight doves signifying the Scarisbrick family connection. Ann had a good relationship with E. W. Pugin, to whom she gave much artistic freedom and who created a lavish living environment for her, down to the smallest details like her inkstand and notepaper. Ann lived to the age of 84, dying in 1872 at Scarisbrick. The estate was inherited by her daughter Eliza, the sole surviving child, after her death and then to her French progeny, Emmanuel de Biaudos, Marquis de Castéja. Scarisbrick Hall was incorporated into the Castéja family properties and the Hall was subject to very few changes. In memory of his wife who died in 1878, the marquis built the church of St. Elizabeth on the site of the former Catholic chapel. Scarisbrick Hall remained in Castéja's family until 1923 when André de Biaudos de Castéja and his wife Pauline d'Espeuilles decided to sell it to Charles Scarisbrick's grandson, Sir Thomas Talbot Leyland Scarisbrick. The building is now occupied by a co-educational, independent school called Scarisbrick Hall School, and there is no public access apart from infrequent guided tours.