You could try passing in half of your sequence, then detaching the output hidden state from the backprop graph, and then pass that output hidden state into the LSTM again along with the second half of the sequence.