In 1501 the Borgia conquered it, although it was returned to the Colonna after the death of pope Alexander VI. The castle was destroyed in 1526 and rebuilt four years later. In 1622 the Ludovisi family acquired Gallicano, followed by the Rospigliosi Pallavicini in 1633, who held it until 1839.