@ptrblck,  “If you call some custom methods from the model, data parallel won’t be used, so instead call your model directly again.”. I am planning to take two outputs from the forward method of the model i.e. validity and feature. Would it help me to solve the problem? I am confused.