I am talking about overall time first of all. It is easy for me to profile Torch train procedure and understand duration of every step, but in TF there is just model.fit(epochs=100) in similar train method, which consumes ~3 times less time than my Torch model. Definitely I can profile .fit method, but as I see - optimizer consumes 40% and it looks too much from the first sight.