Could you post an executable code snippet to reproduce this issue (model definition and input shape information might be enough) as well as information about your setup (PyTorch, CUDA, cudnn version, used GPU)?