Well, I wouldn’t say CNNs are not suitable for NLP tasks. I think it’s not the common choice though.
However, this paper 35 was released last week and claims that CNN architectures are indeed better at sequence modelling than their recurrent counterparts like LSTM.
I haven’t finished reading this paper, but you should have a look at it and keep on with your approach!