Yes I’m manipulating the model during training (after each epoch).
So I think re-wrapping the model to nn.Parallel would be okay.
model = nn.DataParallel(model)
# manipulate the model
model = model.module
model.conv1 = xxxxx
# re-wrap
model = nn.DataParallel(model)

Is this right?