Solved by KFrank in post #2 
              
              
                Hi Shawn! 

F.relu() (which is to say torch.nn.functional.relu()) is a 
function.  nn.ReLU (torch.nn.ReLU) is a class that simply calls 
F.relu().  These two ways of packaging the function do the same 
thing, including when calling .backward(). 

There is no need to instantiate two instances of the n…