@ptrblck Thanks for the reply.


Which way would you recommend in terms of performance? The reason why I’m putting all my data to GPU first is to increase the speed.


When using non_blocking=True, is it okay not to use pin_memory=True in DataLoader? The torch.Tensor.cuda() doc 40 says non_blocking is effective when the data is in pin memory.