Actually the farmers are more concerned that if the illegals go they will actually have to start complying with many laws other employers have to follow.   That would include all the record-keeping and paying SS taxes on what they pay to legal employees, unemployment, workers compensation.