In 1833, Stanley moved up to the more important position of Secretary of State for War and the Colonies, overseeing the passage of the Abolition of Slavery Bill. Stanley, a religiously devout Anglican, broke with the ministry over the reform of the Anglican Church of Ireland in 1834 and resigned from the government. He then formed a group called the "Derby Dilly" and attempted to chart a middle course between what they saw as the increasingly radical Whiggery of Lord John Russell and the conservatism of the Tories. Tory leader Sir Robert Peel's turn to the centre with the 1834 Tamworth Manifesto, published three days before Stanley's "Knowsley Creed" speech, robbed the Stanleyites of much of the uniqueness of their programme. The term "Derby Dilly" was coined by Irish Nationalist leader Daniel O'Connell. Besides Stanley, the other principal members of the Dilly were Sir James Graham, who had resigned as First Lord of the Admiralty; Lord Ripon, who had resigned as Lord Privy Seal; and the Duke of Richmond, who had resigned as Postmaster General. These four ministers had come from notably different political backgrounds—Stanley and Graham were old Whigs, Ripon was a former Canningite Tory prime minister, while Richmond was an arch-conservative Tory who had incongruously found himself in the Grey cabinet. Although they did not participate in Peel's short-lived 1835 ministry, over the next several years they gradually merged into Peel's Conservative Party, with several members of the "Derby Dilly" taking prominent positions in Peel's second ministry. Joining the Conservatives, Stanley again served as Colonial Secretary in Peel's second government in 1841. In 1844 he was summoned to the House of Lords as Lord Stanley of Bickerstaffe in his father's Barony of Stanley by Writ of Acceleration. He broke with the Prime Minister again in 1845, this time over the repeal of the Corn Laws, and managed to bring the majority of the Conservative Party with him (including, among others, the young Benjamin Disraeli). He thereafter led the protectionist faction of the Conservative Party. In the House of Lords, on 23 November 1847, he accused the Irish Catholic clergy of using the confessional to encourage lawlessness and crime. This was disputed in a series of letters by the coadjutor Bishop of Derry, Edward Maginn. In 1851 he succeeded his father as Earl of Derby. The party system was in a state of flux when the Conservatives left office in 1846, the outstanding issues being the question of Ireland and the unresolved franchise.