During the 1560s there was an ongoing dispute with the Ipswich Corporation in relation to various alterations carried out and public access to the annual fair.[1] In 1567 Edmund Withypoll constructed a new pond, now known as the 'Wilderness Pond'. Queen Elizabeth I stayed at the mansion for six days during August 1561.[3] She returned to the town for four days in 1575.[3]