I don’t know if this helps you, but remember that you can backpropagate through a transforms.Normalize. That is, if you are currently giving a normalized image to an optimizer as a parameter you can give the original, unnormalized image instead.