The point of this code is to have inputs that (can) have history. And so these are not parameters.
If you just want to save/set the parameters, you can use the load_state_dict.
If you just want to restore the module to it’s original behavior after using this. You can modify the load weights to actually set nn.Parameter and not Tensors. After that, the .parameters() call will work again.