Solved by ptrblck in post #2 
              
              
                You are doubling the number of input features, as the preceding LSTM gives you num_directions * hidden features. 
The linear layer itself is not “birirectional” in the sense as an LSTM. The incoming activation won’t be processed in a sequential/directional manner. 
You could of course increase the n…