Solved by albanD in post #2 
              
              
                Hi, 
I think that you are storing you self.convrelu as a plain list. Which prevents functions like .parameters or .cuda() to work properly. 
You must use nn.ModuleList() to replace this list (it will behave the same way as a regular python list).