most feared being labeled as fringe thinkers , and if the separate states idea was not carried out , relations with their fellow politicians on the other side of the aisle would be that much more difficult .