andersjing:

Does it mean that the dataloader will take up GPU during the feature process?


This shouldn’t be the case, if your Dataset performs all operations on CPUTensors.
Could you run the data loading pipeline alone and check the GPU memory usage?
If the DataLoader approach shows some GPU usage, could you post its code here, so that we could take a look?