t.g:

In my case, if I freeze L2, does L1 still get trained in the back prop? If yes, how?


One of the simple thing you can try is just not include L2 layer in the optimizer, so the gradients will still be computed but it will not update the parameters. Here I presume that you are not using batch-norm or dropout.
See per parameter options 43