the output of CNN should be size of (batch_size, EMB_SIZE, seq_len),
then you may use transpose() to  transpose it to (seq_len, batch_size, EMB_SIZE), after which you are ready for the input of LSTM.
Is this what you need?