It seems to me that the labour market issues we face would exist regardless of how many immigrants are let in.  In the long term jobs are at risk from automation.  We have fewer middle income people who can afford or are willing to pay high income tax rates.