Same thing is happened.
Every gradients are zero. If i use the output of network not from register_forward_hook, the gradients are not zero.(Checked.)
Can you see my new question in here 167?
The same contents, but maybe more easy to understand what I want to say.
Thank you, @tumble-weed