the castle was refortified in stone from 1242 when sybil turberville, hugh's daughter, married sir grimbold pauncefote (or "paunceforte"), who thus gained possession. it was walled with substantial stone towers and a large bailey, a home castle befitting an important royal ally in wales. the castle was in the hands of the powerful mortimer family dynasty of marcher lords and in the 14th century and declined as a smaller holding within a large portfolio of lands, titles and larger castles.