Solved by ptrblck in post #2 
              
              
                I’m not familiar with the mentioned Lesson in FastAI, however from a code perspective you are detaching the computation graph from vert and hori by using numpy.dot and rewrapping the result in a tensor with requires_grad=True. 
Since vert and hori are already nn.Parameters, you could stick to PyTorc…