If the government can declare a group to be a terrorist organization based on the conduct of some members, the criminalization of political speech could be unlimited.
Why Trump's tweet labeling 'antifa' a terrorist group is so dangerous