What’s your code to load the model? Try doing something like this:
model = MyNetwork()
model.load_state_dict(path_to_file)
model = torch.nn.DataParallel(model).cuda()
optimizer = torch.optim.RMSprop(model.parameters(), lr=opt.lr, alpha=0.99, eps=1e-8, momentum=0, weight_decay=0)

i.e. load the model before constructing the DataParallel and create the optimizer after creating the data parallel.