@smth You are really quick! 
In my case, if .cuda() can copy the parameters of the list of layers, the code can be much nicer, especially when there are many layers. So, is there any solution for my case?
Many thanks!
Ben