Hello,
I am trying to do the exact same thing 2 years layer. And i have the same problem.
Keras. version = 2.2.4
Tensorflow. version = 1.11.0
PyTorch = 1.0.0a0+ff608a9
I transformed and loaded weights from keras to pytorch equivalent model and the activity diverges quickly. Not sure where the problem is.
I see the same issue when i tried the script/example notebook in the repo: https://github.com/gzuidhof/nn-transfer/blob/master/example.ipynb 58
Any suggestions/tips will be highly appreciated.