Solved by ptrblck in post #2 
              
              
                I’ve worked on a tutorial for imbalanced training some time ago (and would need to update it to the latest PyTorch version) by creating an artificially imbalanced CIFAR10 dataset. You can find the code here. Maybe you could use it as a starter.