Thank you, but looks like they only consider the case when model is feed-forwarded or the inference time.
I need something to calculate FLOPs for both backpropagation and feed-forward.
Or am I wrong, these codes also work for backpropagation?