Solved by lzj9072 in post #2 
              
              
                I have found the solution… 
if the model contains GRU layer, you should load the model in cpu then to the gpu. 
model = torch.jit.load(model_path, map_location=torch.device("cpu"))
model = model.cuda()