Numpy, Data Cleaning.
numpy.percentile() and numpy.mean() that help identify outliers based on threshold values or statistical measures. You can then choose to remove or transform these outliers as necessary. Removing Duplicates: NumPy’s numpy.unique() function is handy for identifying and removing duplicate entries