I can’t edit or delte the post for some reason. Anyway after some more reproducible experiments I fixed a few bugs in my code and now the two optimizers give almost the same result. This is a reasonably small discrepancy so I’m retracting the the post 
TF: 0.005030287380910818
PT: 0.0051292076167447093