Solved by ptrblck in post #3 
              
              
                I don’t think applying a weighted sampling to the validation and test data would be a valid step. 
In my opinion the validation dataset is a proxy of the test dataset and should give you a signal how well your model would perform an new unseen data and can be used for e.g. early stopping. 
Once you…