Thank you for the reply.
I am utilizing torch.no_grad() and I have to load 5 images per run of the algorithm.
The question was more around why PyTorch is not utilizing DataParallel as intended.
This is for (1) batch.
This is more a case of the model itself being large, would it require explicit ModelParallel sort of optimization?