Three methods have been used:
The first is that all data sets are used for training, the training time is too long, and a large amount of negative data is likely to cause over-fitting.
The second is to add num_workers to the dataload. This multi-process approach will reduce the training time of a single epoch, but the model predicts performance is degradation.
The third is upsampled positive samples. The positive sample is expanded to as much as the negative sample, and the total sample is random.shuffle and divided into ten groups:
The model is trained separately for these ten group samples, and then the model weights are averaged. The prediction performance of this new model is lower and there is almost no prediction effect.
In addition, I also use the migration learning method. After the first data set is trained, then the first model is used to migrate to train the second data set…, so that the predicted performance of the final training model is lower than the first method.