The children of Howel ap David ap Gruffydd Fychan of Talwrn adopted the surname Powell. A succession of the Powell family owned the hall. Members of the Powell family who owned the hall included, in about 1540, Thomas Powell, the Constable of Holt Castle, who built ‘Plas Y Horsli’ a timber building surrounded with a moat on the site. In 1792, John Hughes possessed Horsley Hall, with it passing to Dr Francis James Hughes. Townshead and Frederick Potts jointly bought the hall, but through a deal, Frederick Potts became the sole owner. In about 1875, the owner Frederick Potts demolished the timber building and replaced it with a stone building. He resided at the hall until his death in 1898. Between 1898 and 1910, Alfred Ashworth owned Horsley Hall. In 1906, he extended the estate by purchasing 700 acres of the adjoining Parkside estate. Between 1907 and 1912, the hall was enlarged, remodelled in a Jacobethan style, and had a formal garden laid out by the architect George Herbert Kitchin (1870-1951). In 1910, Phillip Henry Ashworth, his only son, inherited the estate. In 1917, the hall was bought by Colonel Hall Walker MP and further improvements made to it. On 27 July 1933, Horsley Hall was sold by auction. The advertisement for the sale describes the Hall in detail. The hall had an outer and entrance hall, Saloon, hall with beamed ceiling, library, gallery, four reception rooms, 20 principle bedrooms and dressing rooms, theatre room, school room, 9 bathrooms, servants bedrooms, head grooms house, chauffeurs cottage, gardeners flat, stabling for 18 horses and 3 garages. Mentioned was the formal gardens and golf course. The sale also included the contents of the hall. On 5 July 1934, the remaining parts of the estate were due to be auctioned. In 1934 a decision was made to demolish Horsley Hall. At the start of the Second World War, Horsley Hall was still standing and requisitioned by the army. During the war, it was for training and accommodation by Number 12 Camp, Royal Pioneer Corp. Built in the formal gardens were Nissen huts, garages and military building. On 20 April 1950, Horsley Hall was mentioned in the House of Commons when a Member of Parliament raised a question about Lance-Corporal Sankey, Royal Warwickshire Regiment, never seen again and reported as a deserter after leaving the camp on 25 September 1944.