If I understand your issue correctly, you are creating a two-layer RNN while loading a single layer state dict?
Do you want to initialize the second layer randomly while loading the parameters for the first one?