Yes, but that was just a mistake on my side.
I was using a 3x3 kernel further down the PyTorch network instead of a large 7x7 kernel in Keras. By replacing it, I get about the number of parameters I was expecting.
Thanks for your help!