From the look of the code, cuda() is never called directly on modules. Instead they are called on the parameters of the modules.
So you can try to track the cuda status of the parameters of your layer.