The word "immigrant" isn't the major problem (even though "alien" is actually the more accurate word for this context).  Conflating LEGAL immigration with ILLEGAL immigration is the crux of the problem.  It's like conflating the walking out of a bank with YOUR money versus with EVERYONE ELSE'S money because you just robbed the bank.