The greater part of the senators and nobles openly professed that they would much have preferred the rightful heir , but as they could not recognise him either in the Prince or me , they chose to consider us as impostors and threw us into prison . '