Solved by Bjorn_Lindqvist in post #4 
              
              
                No. Categorical crossentropy (cce) loss in TF is not equivalent to cce loss in PyTorch. 
The problem is that there are multiple ways to define cce and TF and PyTorch does it differently. 
I haven’t found any builtin PyTorch function that does cce in the way TF does it, but you can easily piece it to…