Solved by ptrblck in post #7 
              
              
                I cannot find any obvious issues by skimming through the models. 
Try to add print statements into the forward methods of all models and check, if the activations have a valid .grad_fn via print(x.grad_fn). 
At one point in a model the statement should return None and the previous operation would de…