I would guess the sensitivity to small changes in the input data depends on the signal and noise in the input data.
E.g. if your input signal has a very low magnitude, your model would have to learn these small differences to correctly predict the output.
On the other hand, you might try to add noise to the input to make the model more robust.