What about those Catholics who publicly defy the Church's teachings on abortion, same sex marriage, contraception, etc. ?  They are not in union with the pope and by your argument not Catholic either.