Solved by KFrank in post #2 
              
              
                Hi James! 

I’m not entirely sure what you’re asking or how you intend to use 
your ModuleList, but note that a torch.nn.ReLU is a Module 
so you can include it in your ModuleList, in between, for example, 
some torch.nn.Linears. 
Best. 
K. Frank