 They were overthrown by the Civil Rights Act of 1866 that gave the freedmen more legal equality (although still without the right to vote).The freedmen, with the strong backing of the Freedmen's Bureau, rejected gang-labor work patterns that had been used in slavery.Instead of gang labor, freed people preferred family-based labor groups.