If you are working with text, higher accuracy probably could be reached by using a pretrained transformer model. Usually it achieves better results than simple sequential models. You can find pretrained models on TF Hub. As for examples of using them and fine-tuning to your specific task, you can look at Kaggle or Keras code examples (Natural Language Processing 2).