Thank you for the answer.
I need to add another weight to the LSTM and change the gate functions of it, so it is the best I can found to modify.
Maybe it will be slower but at least it will work the way I wanted.