Hi,
I hope its not too late. I also have encountered the same issue while extracting C3D features for my work. I managed to solve it by adding this line
net.volatile=True
probably you could also try something similar and make it work keeping your cudNN enabled.