I mean, as far as I understand, if you are optimizing a tensor that means somehow that tensor is gonna “remain” during several iterations.  It’s a bit diff to discuss about this not knowing what are you trying to do but yes, iterating over that tensor until you reach your target would be the expected pipeline.
Whether the adecuate criteria were loss or any other metric, I cannot know.