I don’t know how you could like to concatenate the layers and how this would be related to loading the pretrained weights, so could you explain this idea a bit more, please?
Yes, this approach looks valid.




 R_S:

Also, in both case, what is the affect of freezing the features. Should i train it or not?


It depends on your use case and you would have to run experiments to determine if freezing the layers would work for you. Often the feature extractor is frozen, if the new dataset is “similar” to the pretrained one (ImageNet), but I wouldn’t claim that’s a general rule.