An accuracy of 13% suggests that something is either not initialized or there is a preprocessing mismatch between the models. Can you check both versions on a single input image and observe the outputs (even at intermediate parts of the model if necessary) to see where they differ?