I would confront him, but let him know that you're not bothered by it. Encourage him to be open about it. I'd say the majority of people wouldn't be so comfortable with it, obviously, but if you are then that's awesome.