Thanks for pointing that out. I didn’t know I can assign DataParallel to the whole Net before.
I tried couple of runs so I am sure it’s not about the weight initialization. The Keras version always went above 85% validation acc at the end, but Pytorch version is only aroud 70% acc.
What do you mean by different learning schedule?
I think I will look whatis the difference between data preprocessing next step.