Solved by tom in post #2 
              
              
                You likely want nn.Module for holding the parameters, in fact see the PyTorch implementation of nn.PReLU and also the What is torch.nn tutorial. 
Best regards 
Thomas