Thanks for that. But it is still tough for me to grasp the idea. Can you show me an example?
Maybe for this one:
I have a LSTM model with 3 layers
lstm1 =  nn.LSTM(150, 100, num_layers=1, batch_first=True)
lstm2 = nn.LSTM(100, 110, num_layers=1, batch_first=True)
lstm3 = nn.LSTM(110, 200, num_layers=1, batch_first=True)
and during backpropagation,
I want to apply the norm1(lstm1 weights) only on lstm1 and similarly for other layers. How should my loss function look like?