cbaziotis:

return representations, attentions


Hi @cbaziotis, I have a little doubt about how the SelfAttention output should be used …
The representations.shape should be (batch_size, hidden_size) and attentions.shape should be (batch_size, max_len).
How should they be used inside an lstm? What exactly do these two variables represent to me?