nafise:

Attentiom_map = torch.nn.Softmax(Score)


This seems incorrect. Here you are creating the Softmax module. but not performing softmax.
You can either call Score.softmax() or F.softmax() from nn.functional.