Hi,
Have you gone through the custom dataset pytorch docs?
In this 137 website, they use a dataset-dataloader pipeline with the dataset being a custom class loading from a csv file, you can modify appropriately based on your .tsv file.