The house is built of red brick, and was originally constructed to a traditional Elizabethan era H-plan; the southern, garden frontage was infilled during the Lauderdales' rebuilding. The architect of Vavasour's house is unknown although drawings by Robert Smythson and his son John exist. The Lauderdales first consulted William Bruce, a cousin of the Duchess, but ultimately employed William Samwell to undertake their rebuilding.