Two castles were erected on two opposite hills, one being named the Valdagno castle and the other the Panisacco Castle. However the Vicenza comune started very soon to contend it to the Trissino family, who in turn joined forces with Scaligers to defend it.