 From 2015 to 2017, Kempa served as Chief of the Chancellery of the Prime Minister.On 4 November 2011 she, along with 15 other supporters of the dismissed PiS MEP Zbigniew Ziobro, left Law and Justice on ideological grounds to form a breakaway group, United Poland.In December 2015 it gained media attention after sending a letter to the President of the Constitutional Tribunal, Andrzej Rzepliński, informing him that the publication of the judgment of 3 December 2015 on K 34/15 concerning the conformity with the Constitution of the Republic of Poland of certain provisions of the Act of 25 June 2015 About the Constitutional Court].