For months the prime minister fought off calls to name a date for stepping down , despite the increasing fears that a delay would hurt his party in the next election and the growing unpopularity at home for his firm backing of American policy in Iraq and the Middle East .