A group of overt racists and a group of people standing up against racism are not on equal footing, even if there are bad actors in the former camp. 

Intolerance of racism and bigotry is never a bad thing.