nn.ParameterList will make sure to register all parameters properly, so e.g. that they will be pushed to the device, if you call model.to('cuda:0').
Each nn.Parameter should require gradients by default.