Considering the Tories gained seats in the following election and then won a majority four and half years later, I don't think it hurt them at all.  They lost eventually, but it was over other reasons as well as general fatigue with the government.