Originally the 13th-century fortress of Naples ' French ruler Charles d 'Anjou , it was rebuilt in the 15th century as a palace for the Spanish kings of Aragon .
The original fortress was torn down when the Spanish kings of Aragon rebuilt it as a palace .