 He had returned to the Conservative Party (the official name of the Tory Party since the 1850s) before his succession, and when the party came to power in 1866 under the Earl of Derby, Devon was appointed Chancellor of the Duchy of Lancaster (although without a seat in the cabinet) and admitted to the Privy Council.He remained in this post until May the following year, when he became President of the Poor Law Board.However, in contrast to his predecessor in the post, Gathorne Hardy, he was not included in the cabinet this time either.