If you don’t need it “on-the-fly”, e.g. for data augmentation, you could also save the features of both models to your disc and load it afterwards for the LSTM model.
Might keep the code a bit cleaner.