Thanks for the isolation.
What were the performance numbers for this module before the 1.3 release and after, as you’ve mentioned that the regression was introduced there?
Since this layer doesn’t use any 3rd party libs such as cudnn, native PyTorch functions seem to have introduced the regression (source code 1).