It is, no doubt, irritating to be misquoted, but at least you retain the moral high ground and a sense of yourself as wise and well-spoken, albeit misunderstood.
Being misquoted is not something that is irritating.