What he said seems rather tame, to be honest. Look at the way Democrats implied during the JCPOA negotiations that Jews had dual allegiance and that the Jewish lobby formed a fifth column foreign body in the US. Now that was antisemitic! 

A lot of people have ideas about the 'appropriate' amount of influence that Jews should have, but most of these people couldn't give a principled explanation for why.