Maybe one solution (aside the obvious of trying to improve your model accuracy) is to post process the results outside your model.
your model gives an answers → you compare to a threshold → if not good enough, return the default value