Hello,
I acquired a dataset with tweets where i did some preprocessing on it and now is the moment to load it in Pytorch in order to create and test some models.  It’s the first time that I will use a custom dataset and thus it’s the first time for me to manually handle the dataloaders and the Dataset class.
My questions are these:
First of all, what is the appropriate way to organise the csv files before feeding them to the dataloader? 1 file with all the tweets and their labels?  2 csv files with the tweets and their labels for train and test (train_data, test_data)?  or 4 files (train_x, train_y, test_x, test_y)?
Secondly, I am extremely confused on how I should create the dataloaders,  how to implement the Dataset class and how the text should be represented (in which form) etc.
Can anyone guide me or give me some good resources regarding that specific procedure?
Thanks in advance