NLP, Python, Transformers, Data Science, Linear Regression.
a hard time converging, I ran the Trainer for 100 epochs, and the best model was found at epoch 44. Even though the best R2 is only 0.4643 (which means only roughly 46% of the log10 of total scores can be explained by the essays embeddings.), we can see a clear trend of learning (R2 = -2.4783 means