Solved by albanD in post #6 
              
              
                It’s not going to be very clean. But the following should work: 
import torch
from torch import nn


model = nn.Sequential(nn.Linear(2, 2))
# Save the location of the parameters now
# Since we delete them later, we won't be able to call this function anymore
model_params = list(model.named_parameter…