Hi all,
I am new to pyTorch, but I have been using Torch for more than a year now.
Basically, I implemented an autoencoder model with gru as encoder and decoder, and it is a multi-gpu implementation. When I incorporate gradient clipping to training, the training gets slower, and it is probably 4 times slower than the training without gradient clipping.
Is it normal? Or is it an issue with my implementation?
Thank you so much for your time.