Solved by mrityunjay in post #2 
              
              
                Ohh. Got it! It is already solved here https://github.com/pytorch/pytorch/pull/28637/files. Seems like I need to upgrade PyTorch