 The house was described as "somewhat fallen into decay"; it was replaced in 1585 by a new house built by Sir Walter Mildmay.Chauncy described it as a "very neat and fair Pile of building for the Manor-house, upon a rising Ground in the Vale near the River Stort, lately converted into a Paddock for Deer, adorned in the Front thereof with a fair Bowling Green, raised about five Foot high, enclosed with a Brick Wall top with stone, and balls upon it, and two fair walks planted with trees; each walk extending about four Furlongs in length from the house to the road; where it is observable that there is no dust in summer, nor no dirt winter, a clear description of the setting of an Elizabethan house in its ground.The estate passed from the Gardiner family on the marriage of Rose Gardiner (1757-1835) (whose memorial tablet exists in St Mary's Church, Sawbridgeworth), daughter and heiress of Edward Gardiner (d.1779) of Pishiobury, to Jeremiah III Milles (1751-1797), son of Rev.