As some of those white colonialists at that time, they weren't the most liberal thinking people and they probably didn't appreciate this idea of freemen of color being able to have all of the same rights as they did.