For sure an issue. In a healthy relationship there really shouldn't be any taboo topics to be so petty about.
I would definitely approach him about opening up in that department or see counceling. This just sounds really off.