There is no "moral difference."  The Antifa movement is just as extremist and violent, perhaps even more so, than the the alt-right.  Check out an article in the September 2017 edition of The Atlantic titled, "The rise of the Violent Left."