Dataloader works with directories containing data files (for example images), in your case you just want to open a csv, so you should keep using pandas. After this you can still convert your pandas arrays into pytorch tensors.