Thank you for your response! Do you mean lstm.bias_hh_l1, lstm.bias_ih_l1, lstm.weight_hh_l1,  lstm.weight_ih_l1, plus the reverse version of these? Because I am trying to remove the second layer of lstm in the state dictionary of the model? And can you please show it with an example for more clarification?