Sorry, I’m replying but I don’t have an answer to you.
What I’d suggest to maybe help you is, if you want to use TF 2.x and with another text embedding, you can try this tutorial: Classify text with BERT  |  Text  |  TensorFlow