To level the playing fields between both Tensorflow and PyTorch:

Both are now using “Glorot Uniform” Initializer.

Bias is turned off for both the models.

New Tensorlfow model loss function:

Tensorflow_no_bias.png1920×955 29.1 KB

New PyTorch model loss function:

PyTorch_no_bias.png1920×955 29 KB

Tensorflow minimum loss: 0.00354829
PyTorch minimum loss: 0.011800370