Solved by albanD in post #2 
              
              
                Hi, 
You have two kinds of Tensors that a Module want to hold to: 

Some that are learnable. Represented as nn.Parameter and that should be registered with mod.register_parameter("name", value) where value can be either None or an nn.Parameter
Some that are not learnable. Represented as regular torc…