Hi I just wanted to say I think I solved this problem!
I did some more analysis and found that the features were not as strong predictors of the target variable as I had originally tested. Which explains why this more or less linear model got stuck.
After some feature engineering I’m getting much better results!
Thank you for your help!