on the royal command of new king king henry iv in 1400, it was again refortified, this time by sir john pauncefote, great-grandson of sir grimbold, in advance of the uprising led by owain glyndŵr. the castle was largely destroyed in about 1403 by glyndŵr's forces. who also attacked and burned abergavenny town and other settlements in the area. it was at this time that the castle is thought to have been abandoned, subsequent stone-robbing leaving only the ruined stone double tower on castle green. however, 19th century illustrations suggest that its condition has deteriorated noticeably in the past century. it was listed in 1963.