Hi,
Sorry for this kind of question, it is maybe because I’m too weak at linear algebra.
I am trying to implement new optimizer strategy. The author mentioned this formula.

Where gk is the gradient tensor and pk is the same shape tensor as gk. For example, if the gradient tensor has the shape (c,m,n) then its transpose tensor will have the shape is (n,m,c).
How can I do the multiplication between two tensors to get the scalar result? In that paper:

The author also told that pk different from 0 and the multiplication is smaller than 0.