Solved by ptrblck in post #7 
              
              
                It seems one BiasAdd module is reused somewhere in the code, but I cannot spot the line. 
This should be unrelated to your current issue, but I would recommend to setup the bias tensor and wrap it into nn.Parameter as the final step to create a leaf variable. 
Currently you are creating a non-leaf v…