Solved by albanD in post #2 
              
              
                Hi, 
These values are not stored at the torch.nn level. They are handled by the autograd directly that stores them along with all the informations needed to perform the backward pass.