Puh, I was running out of ideas and couldn’t believe that the model is overfitting that much even with weighted sampling. 
Feel free to post updates on your experiments, as I’m always interested in these imbalanced cases.