If your dataset is really small and you don’t need batching, you can just push the data onto the GPU and simply apply your training procedure.
However, since I like the concept of a Dataset and DataLoder, I would still use a DataLoader in such a use case just to be able to easily extend the dataset and use batching, shuffling etc.