text: Do whats best for the kids, if it bothers you it will show in how they react to him.  Being from a broken family is hard enough on them.  He knows it bothers you and will stop hanging around once you stop caring.  Don't mention it in front of the kids and he will think you no longer care.