Solved by Chillee in post #2 
              
              
                The module isn’t stored on the node itself, but the node contains the qualified name of the module. So you can use the qualified name to query the module itself to obtain the actual module, with which you can just query the parameters. 
See pytorch/optimization.py at master · pytorch/pytorch · GitHu…