Hey, DataParallel is compatible with most forward functions, but you seem to be doing something that won’t work. You’re accepting two inputs and a batchSize argument, but note that all instances of the model will get only parts of the batch, while the same batchSize will be sent to all of them. It’d be better if you used e.g. batchSize = input1.size(0) in your forward.