You could create a custom Dataset as described here 31.
Inside the __init__ you could store the DataFrame, and load each row in __getitem__ e.g. via self.df.iloc[idx].
Once you have the row, you could get the path and score, load and process the image, and return the data and target.
Let me know, if you get stuck somewhere.