There are some sample weighting techniques for such data.
See: https://arxiv.org/abs/1803.09050 1
This is in fact something I personally implemented a few days ago. Maybe my implementation can help you: https://github.com/TinfoilHat0/Learning-to-Reweight-Examples-for-Robust-Deep-Learning-with-PyTorch-Higher 2