Solved by DivyanshJha in post #2 
              
              
                Figured it out!! 
Correction is max_norm should be None not False 
outputs = F.embedding(inputs, self.weights * (self.dmodel ** 0.5), self.pad_idx, None,2, False, False)