 However, they came into a feud with the Clan Ruthven who often disputed the authority of the Charterises.The Ruthvens held considerable sway over Perth from their Huntingtower Castle.In 1544 Patrick, Lord Ruthven was elected as Provost of Perth but at the intervention of Cardinal Beaton, Ruthven was deprived of the office and Charteris of Kinfauns was appointed instead.