before the dissolution of the monasteries, the site belonged to leicester abbey. it was then sold by the crown to francis cave, whose grandson, sir alexander cave, sold it on before 1625 to edward villiers, half-brother of the duke of buckingham.