I meant the validation/test set. Changing the learning net didn’t make a difference. Increasing the model size made it worse.
However, what finally made it work was some additional topic-specific preprocessing. I now have 87% accuracy.
Thank you for your response. Very very appreciated