When the input becomes (even slightly) negative, the operational amplifier runs open-loop, as there is no feedback signal through the diode. For a typical operational amplifier with high open-loop gain, the output saturates. If the input then becomes positive again, the op-amp has to get out of the saturated state before positive amplification can take place again.