NLP, Python, Transformers, Data Science, Linear Regression.
in Portuguese, I picked the “neuralmind/bert-large-portuguese-cased” as the base model. Image by author Since the essays are long documents, the average length is longer than the default max length of the most pre-trained models; I just set the max_length to 512 to capture the most information. The