Solved by JuanFMontesinos in post #2 
              
              
                a nn.Parameters is a container aimed to create learnable tensors inside a nn.Module 
That’s why it keeps tracking the grad, as any other parameter in a nn.Module would do. Besides, 
You are instantiating the Parameter class with rand0.3 as argument, meanwhile in the other case the variable which has…