Solved by albanD in post #2 
              
              
                You should save alpha_list as a ParameterList to ensure it is detected properly by the rest of the nn code. 
You can also create a single vector of size the number of alpha and then do a dot product to compute your loss.