I’m unsure, if mixing TensorFlow and PyTorch would work, so it would be interesting to hear what your use case is and if a similar approach would work before.
You can find the InceptionV3 definition here 1 and see how each layer is used.