Solved by albanD in post #5 
              
              
                You will have to differentiate between the leant parameter in netB and the ones that are computed at each forward. 
One thing you cal do is rename parameters like weight into weight_orig. Then del the weight. And in the forward part, set the weight as weight_orig + your_udpate.