Yes theoretically this is a very good idea but I will have a hard time mapping the parameter names from TF to Pytorch since they don’t share the same names and I think I will have to do the mapping manually. My model is huge so I can imagine that this will take sometime. But that’s an idea worth trying, thank you!