In the past , the most obstinate white opponents of integration ( the Goldwater wing of the Republican Party and conservative Southern Democrats ) argued that people should have the right to associate--or not to associate--with whomever they wish .
Opponents of integration articulated their position on the basis of social standing making freedom of association immoral .