Solved by lgusm in post #3 
              
              
                Hi Sid, regarding the preprocess model, To understand what’s going on behind the scene, I’d look on how to use a BERT model without the preprocessing help (Fine-tuning a BERT model  |  Text  |  TensorFlow). As you can see, there’s a lot of boilerplate code to transform text to the proper input. That…