Solved by ptrblck in post #2 
              
              
                If you are dealing with a different number of features for the batchnorm layer, you could add a condition into your model, which would then pick the right batchnorm layer for the current input. 
I’m not familiar with your use case, but maybe it would also make sense to slice and copy the batchnorm l…