The sleight of hand works because we assume that the action will cancel all the effects of inaction, whereas of course, nothing like that is true. This becomes much clearer if we substitute much smaller action than Barroso envisions.