the second wave of construction of the castle may have followed the appointment of de caux to hereditary keeper of the royal forests of nottingham and derbyshire, although the extent of renovations undertaken by king john, who seized the castle for several years in 1204, is unknown. in 1230, the property and title passed to the everingham family, until they were stripped of the title in 1286; the property found insufficient to sustain the family further, they left it for other property in yorkshire. the castle subsequently fell into disrepair.